Jul 25 02:25:20 devstack cinder-volume[77259]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 25 02:25:20 devstack cinder-volume[77259]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 25 02:25:20 devstack cinder-volume[77259]: we strongly recommend against using it for new projects. Jul 25 02:25:20 devstack cinder-volume[77259]: If you are already using Eventlet, we recommend migrating to a different Jul 25 02:25:20 devstack cinder-volume[77259]: framework. For more detail see Jul 25 02:25:20 devstack cinder-volume[77259]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 25 02:25:20 devstack cinder-volume[77259]: import eventlet # noqa Jul 25 02:25:23 devstack cinder-volume[77259]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:25:23 devstack cinder-volume[77259]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:25:23 devstack cinder-volume[77259]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:25:24 devstack cinder-volume[77259]: INFO dbcounter [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Registered counter for database cinder Jul 25 02:25:24 devstack cinder-volume[77259]: DEBUG oslo_db.sqlalchemy.engines [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG dbcounter [-] [77259] Writer thread running {{(pid=77259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.rpc [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.rpc [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG oslo_db.sqlalchemy.engines [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.volume.manager [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Determined volume DB was empty at startup. Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG cinder.volume.manager [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77259) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.volume.manager [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 25 02:25:25 devstack cinder-volume[77259]: WARNING stevedore.named [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 25 02:25:25 devstack cinder-volume[77259]: WARNING castellan.key_manager [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:25:25 devstack cinder-volume[77259]: WARNING cinder.keymgr.conf_key_mgr [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG cinder.volume.drivers.lvm [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77259) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG oslo_concurrency.processutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG oslo_concurrency.processutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.410s {{(pid=77259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG oslo_db.sqlalchemy.engines [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.rpc [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.rpc [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 25 02:25:25 devstack cinder-volume[77259]: WARNING stevedore.named [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 25 02:25:25 devstack cinder-volume[77259]: WARNING castellan.key_manager [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:25:25 devstack cinder-volume[77259]: INFO cinder.volume.manager [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 25 02:25:25 devstack cinder-volume[77259]: DEBUG oslo_db.sqlalchemy.engines [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:25:25 devstack cinder-volume[77259]: INFO oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Starting 1 workers Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Started child 77444 {{(pid=77259) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Full set of CONF: {{(pid=77259) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] ******************************************************************************** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Configuration options gathered from: {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] ================================================================================ {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] allow_availability_zone_fallback = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] allow_compression_on_image_upload = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] allowed_direct_url_schemes = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] api_rate_limit = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] auth_strategy = keystone {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77444]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] az_cache_duration = 3600 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_availability_zone = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_host = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_stats_polling_interval = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backup_api_class = cinder.backup.api.API {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backup_name_template = backup-%s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backup_use_same_host = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backup_use_temp_snapshot = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] chap_password = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] chap_username = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_internal_tenant_project_id = b375f8a96f654f7dbc64c141ec29bd1b {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_internal_tenant_user_id = 01a339c3bc4f46c9a0e9218fd1c97dad {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cloned_volume_same_az = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cluster = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] compression_format = gzip {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] compute_api_class = cinder.compute.nova.API {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] config_dir = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] config_source = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] control_exchange = openstack {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] debug = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] default_availability_zone = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] default_group_type = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] default_volume_type = lvmdriver-1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] disk_geometry = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] driver_client_cert = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] driver_client_cert_key = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] driver_data_namespace = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] driver_ssl_cert_path = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] driver_ssl_cert_verify = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] driver_use_ssl = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] enable_force_upload = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] enable_new_services = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] enable_unsupported_driver = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] enforce_multipath_for_image_xfer = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] filter_function = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_api_insecure = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_api_ssl_compression = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_ca_certificates_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_catalog_info = image:glance:publicURL {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_num_retries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance_request_timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] goodness_function = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] graceful_shutdown_timeout = 5 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] group_api_class = cinder.group.api.API {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] host = devstack {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77444]: INFO cinder.volume.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_compress_on_upload = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_conversion_address_space_limit = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_conversion_cpu_limit = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_conversion_disable = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_upload_use_cinder_backend = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_upload_use_internal_tenant = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_volume_cache_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_volume_cache_max_count = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] image_volume_cache_max_size_gb = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] init_host_max_objects_retrieval = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] instance_format = [instance: %(uuid)s] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] iscsi_target_flags = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] iscsi_write_cache = on {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] iser_helper = tgtadm {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] iser_ip_address = 192.168.122.192 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] iser_port = 3260 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_color = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_config_append = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_dir = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_options = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_rotate_interval = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_rotate_interval_type = days {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] log_rotation_type = none {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] max_age = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] max_logfile_count = 30 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] max_logfile_size_mb = 200 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] max_over_subscription_ratio = 20.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] message_reap_interval = 86400 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] message_ttl = 2592000 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] migration_create_volume_timeout_secs = 300 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] monkey_patch = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] monkey_patch_modules = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] my_ip = 192.168.122.192 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] no_snapshot_gb_quota = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] num_iser_scan_tries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] num_shell_tries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] num_volume_device_scan_tries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] nvmeof_conn_info_version = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] nvmet_ns_id = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] nvmet_port_id = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_max_limit = 1000 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_volume_ext_list = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_volume_listen_port = 8776 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_volume_use_ssl = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] osapi_volume_workers = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] per_volume_size_limit = -1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] periodic_fuzzy_delay = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] periodic_interval = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] public_endpoint = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] publish_errors = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_backup_gigabytes = 1000 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_backups = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_gigabytes = 1000 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_groups = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_snapshots = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] quota_volumes = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] rate_limit_burst = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] rate_limit_except_level = CRITICAL {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] rate_limit_interval = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] reinit_driver_count = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] replication_device = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] report_discard_supported = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] report_interval = 120 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] reservation_clean_interval = 86400 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] reservation_expire = 86400 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] reserved_image_namespaces = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] reserved_percentage = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] rpc_response_timeout = 120 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] run_external_periodic_tasks = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] scst_target_driver = iscsi {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] scst_target_iqn_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_down_time = 720 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] shell_completion = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] snapshot_name_template = snapshot-%s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] snapshot_same_host = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] split_loggers = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] state_path = /opt/stack/data/cinder {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] storage_availability_zone = nova {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] storage_protocol = iSCSI {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] syslog_log_facility = LOG_USER {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] target_helper = lioadm {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] target_ip_address = 192.168.122.192 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] target_port = 3260 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] target_protocol = iscsi {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] target_secondary_ip_addresses = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] trace_flags = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] transport_url = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] until_refresh = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_chap_auth = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_default_quota_class = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_journal = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_json = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_multipath_for_image_xfer = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_stderr = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] use_syslog = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] verify_glance_signatures = enabled {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_api_class = cinder.volume.api.API {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_backend_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_clear = zero {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_clear_ionice = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_clear_size = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_copy_bps_limit = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_dd_blocksize = 1M {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_name_template = volume-%s {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_service_inithost_offload = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volume_usage_audit_period = month {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] zoning_mode = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_concurrency.disable_process_locking = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.auth_section = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.auth_type = password {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.auth_version = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.cache = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.include_service_catalog = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.insecure = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.interface = public {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_password = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcache_username = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.region_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.service_type = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.backend = dogpile.cache.null {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.backend_argument = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.backend_expiration_time = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.config_prefix = cache.oslo {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.debug_cache_backend = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.enable_retry_client = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.enable_socket_keepalive = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.expiration_time = 600 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.hashclient_retry_attempts = 2 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_dead_retry = 300 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_pool_maxsize = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_sasl_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.password = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.proxies = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.redis_db = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.redis_server = localhost:6379 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.retry_attempts = 2 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.retry_delay = 0.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.socket_keepalive_count = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.socket_keepalive_idle = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack sudo[77448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.socket_keepalive_interval = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.socket_timeout = 1.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.tls_allowed_ciphers = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.tls_cafile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.tls_certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.tls_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack sudo[77448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.tls_keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cache.username = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] coordination.backend_url = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.asyncio_connection = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.asyncio_slave_connection = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.backend = sqlalchemy {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.connection = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.connection_debug = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.connection_parameters = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.connection_recycle_time = 3600 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.connection_trace = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.db_inc_retry_interval = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.db_max_retries = 20 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.db_max_retry_interval = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.db_retry_interval = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.max_overflow = 50 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.max_pool_size = 5 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.max_retries = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.mysql_wsrep_sync_wait = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.pool_timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.retry_interval = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.slave_connection = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.sqlite_synchronous = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.synchronous_reader = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] database.use_db_reconnect = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.connection_string = messaging:// {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.es_doc_type = notification {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.es_scroll_size = 10000 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.es_scroll_time = 2m {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.filter_error_trace = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.hmac_keys = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.sentinel_service_name = mymaster {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.socket_timeout = 0.1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.trace_requests = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler.trace_sqlalchemy = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler_jaeger.process_tags = {} {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler_jaeger.service_name_prefix = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] profiler_otlp.service_name_prefix = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.enforce_new_defaults = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.policy_default_rule = default {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.policy_file = policy.yaml {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.group = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.helper_command = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] privsep_osbrick.user = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.group = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.helper_command = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] cinder_sys_admin.user = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.auth_section = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.auth_type = password {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.cafile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.collect_timing = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.insecure = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.send_service_user_token = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.split_loggers = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] service_user.timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.auth_section = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.auth_type = password {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.collect_timing = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.insecure = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.region_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.split_loggers = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] glance.timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.backend_availability_zone = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.chap_password = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.chap_username = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.disk_geometry = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.driver_client_cert = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.driver_client_cert_key = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.driver_data_namespace = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.driver_use_ssl = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.extra_capabilities = {} {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.filter_function = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.goodness_function = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.iscsi_target_flags = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.iscsi_write_cache = on {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.iser_helper = tgtadm {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.iser_port = 3260 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.lvm_share_target = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.lvm_type = auto {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.num_shell_tries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.replication_device = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.report_discard_supported = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.reserved_percentage = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.target_helper = tgtadm {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.target_port = 3260 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.target_protocol = iscsi {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.trace_flags = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.unique_fqdn_network = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.use_chap_auth = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_backend_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_clear = zero {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_clear_ionice = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_clear_size = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_reports.file_event_handler = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_reports.log_dir = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.backend_host = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.chap_password = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.chap_username = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.disk_geometry = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.driver_client_cert = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.extra_capabilities = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.filter_function = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.goodness_function = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.iser_helper = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.iser_ip_address = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.iser_port = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.lvm_share_target = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.lvm_type = auto {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.num_shell_tries = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.replication_device = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.report_discard_supported = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.reserved_percentage = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.scst_target_driver = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.storage_protocol = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.target_helper = lioadm {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.target_ip_address = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.target_port = 3260 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.trace_flags = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.use_chap_auth = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_clear = zero {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_clear_size = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] lvmdriver-1.volumes_dir = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_notifications.driver = [] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_notifications.retry = -1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] key_manager.fixed_key = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.barbican_api_version = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.barbican_endpoint = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.barbican_endpoint_type = public {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.barbican_region_name = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.cafile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.collect_timing = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.insecure = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.number_of_retries = 60 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.retry_delay = 1 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.send_service_user_token = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.split_loggers = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.verify_ssl = True {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican.verify_ssl_path = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.auth_section = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.auth_type = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.cafile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.certfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.collect_timing = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.insecure = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.keyfile = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.split_loggers = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] barbican_service_user.timeout = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.approle_role_id = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.approle_secret_id = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.auth_method = approle {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.auth_path = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.kv_mountpoint = secret {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.kv_path = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.kv_version = 2 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.namespace = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.root_token_id = **** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.ssl_ca_crt_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.timeout = 60.0 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.token_file = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.token_role = None {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.use_ssl = False {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:25:26 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] ******************************************************************************** {{(pid=77259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 25 02:25:26 devstack sudo[77448]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack sudo[77564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:26 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:26 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:25:26 devstack cinder-volume[77444]: INFO cinder.brick.local_dev.lvm [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:26 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:26 devstack sudo[77656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:25:26 devstack sudo[77656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:27 devstack sudo[77656]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG cinder.brick.local_dev.lvm [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77444) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:27 devstack sudo[77741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:27 devstack sudo[77741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:27 devstack sudo[77741]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:27 devstack sudo[77938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:27 devstack sudo[77938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:27 devstack sudo[77938]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:27 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:28 devstack sudo[78057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 25 02:25:28 devstack sudo[78057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:28 devstack sudo[78057]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.272s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:28 devstack sudo[78060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:25:28 devstack sudo[78060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:28 devstack sudo[78060]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:28 devstack sudo[78143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:25:28 devstack sudo[78143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:28 devstack sudo[78143]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:28 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:28 devstack sudo[78146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:28 devstack sudo[78146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:29 devstack sudo[78146]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:29 devstack sudo[78171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:29 devstack sudo[78171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:29 devstack sudo[78171]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.367s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:29 devstack sudo[78239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:29 devstack sudo[78239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:29 devstack sudo[78239]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:29 devstack cinder-volume[77444]: INFO cinder.volume.drivers.lvm [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:29 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:29 devstack sudo[78243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:29 devstack sudo[78243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:30 devstack sudo[78243]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG cinder.volume.drivers.lvm [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Updating volume stats {{(pid=77444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:30 devstack sudo[78252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:25:30 devstack sudo[78252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:30 devstack sudo[78252]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:30 devstack sudo[78255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:30 devstack sudo[78255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:30 devstack sudo[78255]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:30 devstack sudo[78258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:30 devstack sudo[78258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:30 devstack sudo[78258]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:30 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:30 devstack sudo[78261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:30 devstack sudo[78261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:31 devstack sudo[78261]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:31 devstack cinder-volume[77444]: INFO cinder.volume.driver [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Driver hasn't implemented _init_vendor_properties() Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG cinder.volume.driver [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77444) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_db.sqlalchemy.engines [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG dbcounter [-] [77444] Writer thread running {{(pid=77444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG cinder.db.api [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Building query based on filter {{(pid=77444) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG cinder.image.image_utils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77444) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 25 02:25:31 devstack cinder-volume[77444]: INFO cinder.keymgr.migration [None req-e30eeba6-9319-4ba6-a85a-ba5c0c46b79b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG cinder.volume.drivers.lvm [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Updating volume stats {{(pid=77444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:31 devstack sudo[78264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:25:31 devstack sudo[78264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:31 devstack sudo[78264]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:31 devstack sudo[78269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:31 devstack sudo[78269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:31 devstack sudo[78269]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:31 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:31 devstack sudo[78273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:31 devstack sudo[78273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:32 devstack sudo[78273]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:32 devstack sudo[78276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:32 devstack sudo[78276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:32 devstack sudo[78276]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG cinder.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Notifying Schedulers of capabilities ... {{(pid=77444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:25:32 devstack cinder-volume[77444]: INFO cinder.volume.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Driver initialization completed successfully. Jul 25 02:25:32 devstack cinder-volume[77444]: INFO cinder.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Initiating service 2 cleanup Jul 25 02:25:32 devstack cinder-volume[77444]: INFO cinder.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Service 2 cleanup completed. Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG cinder.service [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Creating RPC server for service cinder-volume {{(pid=77444) start /opt/stack/cinder/cinder/service.py:231}} Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG cinder.service [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77444) start /opt/stack/cinder/cinder/service.py:237}} Jul 25 02:25:32 devstack cinder-volume[77444]: INFO cinder.volume.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG cinder.volume.drivers.lvm [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Updating volume stats {{(pid=77444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:32 devstack sudo[78281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:25:32 devstack sudo[78281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:32 devstack sudo[78281]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:32 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:32 devstack sudo[78284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:32 devstack sudo[78284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:33 devstack sudo[78284]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:33 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:33 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:33 devstack sudo[78287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:25:33 devstack sudo[78287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:33 devstack sudo[78287]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:33 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:33 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:25:33 devstack sudo[78293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:25:33 devstack sudo[78293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:25:33 devstack sudo[78293]: pam_unix(sudo:session): session closed for user root Jul 25 02:25:33 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:25:33 devstack cinder-volume[77444]: INFO cinder.volume.manager [None req-78ebcc18-10a2-4c04-bdd5-68c7ca535f28 None None] Driver post RPC initialization completed successfully. Jul 25 02:25:35 devstack cinder-volume[77259]: DEBUG dbcounter [-] [77259] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:25:43 devstack cinder-volume[77444]: DEBUG dbcounter [-] [77444] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:25:43 devstack cinder-volume[77444]: DEBUG dbcounter [-] [77444] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:26:12 devstack cinder-volume[77444]: DEBUG oslo_service.periodic_task [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running periodic task VolumeManager._thread_info {{(pid=77444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:26:12 devstack cinder-volume[77444]: DEBUG cinder.volume.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] thread count: 6 {{(pid=77444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:26:12 devstack cinder-volume[77444]: DEBUG cinder.volume.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] thread info: [<_MainThread(MainThread, started 133596737691776)>, , , , , ] {{(pid=77444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:27:12 devstack cinder-volume[77444]: DEBUG oslo_service.periodic_task [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:27:12 devstack cinder-volume[77444]: DEBUG cinder.volume.drivers.lvm [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Updating volume stats {{(pid=77444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 25 02:27:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:27:12 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:27:12 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:27:12 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Jul 25 02:27:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:27:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:27:13 devstack sudo[83483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:27:13 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:27:13 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:27:13 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:27:13 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:27:13 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:27:13 devstack sudo[83489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:27:13 devstack sudo[83489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:27:13 devstack sudo[83489]: pam_unix(sudo:session): session closed for user root Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG cinder.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Notifying Schedulers of capabilities ... {{(pid=77444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG oslo_service.periodic_task [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running periodic task VolumeManager._thread_info {{(pid=77444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG cinder.volume.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] thread count: 6 {{(pid=77444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:27:13 devstack cinder-volume[77444]: DEBUG cinder.volume.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] thread info: [<_MainThread(MainThread, started 133596737691776)>, , , , , ] {{(pid=77444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:27:43 devstack cinder-volume[77444]: DEBUG dbcounter [-] [77444] Writing DB stats cinder:SELECT=1 {{(pid=77444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:27:43 devstack cinder-volume[77444]: DEBUG dbcounter [-] [77444] Writing DB stats cinder:UPDATE=1 {{(pid=77444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:28:12 devstack cinder-volume[77444]: DEBUG oslo_service.periodic_task [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:28:12 devstack cinder-volume[77444]: DEBUG cinder.volume.drivers.lvm [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Updating volume stats {{(pid=77444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 25 02:28:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:28:12 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:28:12 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:28:13 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:28:13 devstack sudo[85097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:28:13 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:28:13 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:28:13 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:28:13 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:28:13 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:28:13 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:28:13 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:28:13 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG cinder.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Notifying Schedulers of capabilities ... {{(pid=77444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG oslo_service.periodic_task [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running periodic task VolumeManager._thread_info {{(pid=77444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG cinder.volume.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] thread count: 6 {{(pid=77444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:28:13 devstack cinder-volume[77444]: DEBUG cinder.volume.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] thread info: [<_MainThread(MainThread, started 133596737691776)>, , , , , ] {{(pid=77444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:29:12 devstack cinder-volume[77444]: DEBUG oslo_service.periodic_task [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:29:12 devstack cinder-volume[77444]: DEBUG cinder.volume.drivers.lvm [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Updating volume stats {{(pid=77444) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 25 02:29:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:29:12 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 25 02:29:12 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:29:12 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Jul 25 02:29:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:29:12 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:29:13 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:29:13 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:29:13 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Jul 25 02:29:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:29:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:29:13 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 25 02:29:13 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:29:13 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Jul 25 02:29:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:29:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:29:13 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 25 02:29:13 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:29:13 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Jul 25 02:29:13 devstack cinder-volume[77444]: DEBUG oslo_concurrency.processutils [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:29:13 devstack cinder-volume[77444]: DEBUG cinder.manager [None req-97feab76-b243-4a27-89f4-28c51922cd9c None None] Notifying Schedulers of capabilities ... {{(pid=77444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:29:43 devstack cinder-volume[77444]: DEBUG dbcounter [-] [77444] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:29:58 devstack cinder-volume[77259]: INFO oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Caught SIGTERM, stopping children Jul 25 02:29:58 devstack cinder-volume[77259]: DEBUG oslo_concurrency.lockutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Acquiring lock "singleton_lock" {{(pid=77259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:29:58 devstack cinder-volume[77259]: DEBUG oslo_concurrency.lockutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Acquired lock "singleton_lock" {{(pid=77259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:29:58 devstack cinder-volume[77259]: DEBUG oslo_concurrency.lockutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Releasing lock "singleton_lock" {{(pid=77259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:29:58 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Stop services. {{(pid=77259) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 25 02:29:58 devstack cinder-volume[77259]: DEBUG oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Killing children. {{(pid=77259) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 25 02:29:58 devstack cinder-volume[77259]: INFO oslo_service.backend._eventlet.service [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Waiting on 1 children to exit Jul 25 02:30:03 devstack cinder-volume[77444]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 25 02:30:04 devstack cinder-volume[87510]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 25 02:30:04 devstack cinder-volume[87510]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 25 02:30:04 devstack cinder-volume[87510]: we strongly recommend against using it for new projects. Jul 25 02:30:04 devstack cinder-volume[87510]: If you are already using Eventlet, we recommend migrating to a different Jul 25 02:30:04 devstack cinder-volume[87510]: framework. For more detail see Jul 25 02:30:04 devstack cinder-volume[87510]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 25 02:30:04 devstack cinder-volume[87510]: import eventlet # noqa Jul 25 02:30:06 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:30:06 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:30:06 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:30:06 devstack cinder-volume[87510]: INFO dbcounter [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Registered counter for database cinder Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d62054-d622-4576-9e85-141be09b157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG dbcounter [-] [87510] Writer thread running {{(pid=87510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 25 02:30:07 devstack cinder-volume[87510]: INFO cinder.rpc [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 25 02:30:07 devstack cinder-volume[87510]: INFO cinder.rpc [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d62054-d622-4576-9e85-141be09b157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:07 devstack cinder-volume[77444]: DEBUG oslo_concurrency.lockutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Acquiring lock "singleton_lock" {{(pid=77444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:30:07 devstack cinder-volume[77444]: DEBUG oslo_concurrency.lockutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Acquired lock "singleton_lock" {{(pid=77444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:30:07 devstack cinder-volume[77444]: DEBUG oslo_concurrency.lockutils [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Releasing lock "singleton_lock" {{(pid=77444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:30:07 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Determined volume DB was empty at startup. Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG cinder.volume.manager [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87510) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 25 02:30:07 devstack cinder-volume[77444]: WARNING amqp [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 25 02:30:07 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 25 02:30:07 devstack cinder-volume[87510]: WARNING stevedore.named [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 25 02:30:07 devstack cinder-volume[87510]: WARNING castellan.key_manager [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:30:07 devstack cinder-volume[87510]: WARNING cinder.keymgr.conf_key_mgr [None req-c1d62054-d622-4576-9e85-141be09b157b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:30:07 devstack cinder-volume[77444]: WARNING amqp [None req-af31d8f0-8c9d-4ffd-8002-f3493e3b7fb2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 25 02:30:07 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d62054-d622-4576-9e85-141be09b157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:07 devstack cinder-volume[87510]: INFO oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Starting 1 workers Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Started child 87729 {{(pid=87510) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Full set of CONF: {{(pid=87510) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] ******************************************************************************** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Configuration options gathered from: {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] ================================================================================ {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] allow_availability_zone_fallback = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] allow_compression_on_image_upload = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] allowed_direct_url_schemes = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] api_rate_limit = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] auth_strategy = keystone {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_availability_zone = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_host = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_stats_polling_interval = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backup_api_class = cinder.backup.api.API {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backup_name_template = backup-%s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backup_use_same_host = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backup_use_temp_snapshot = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] chap_password = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] chap_username = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_internal_tenant_project_id = b375f8a96f654f7dbc64c141ec29bd1b {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87729]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_internal_tenant_user_id = 01a339c3bc4f46c9a0e9218fd1c97dad {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cluster = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] compression_format = gzip {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] compute_api_class = cinder.compute.nova.API {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] config_dir = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] config_source = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] control_exchange = openstack {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] debug = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] default_availability_zone = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] default_group_type = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] default_volume_type = QuobyteHD {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] disk_geometry = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] driver_client_cert = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] driver_client_cert_key = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] driver_data_namespace = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] driver_ssl_cert_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] driver_ssl_cert_verify = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] driver_use_ssl = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] enable_new_services = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] enable_unsupported_driver = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] enabled_backends = ['QuobyteHD'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] enforce_multipath_for_image_xfer = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] filter_function = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_api_insecure = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_api_ssl_compression = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_ca_certificates_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_catalog_info = image:glance:publicURL {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_num_retries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance_request_timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] goodness_function = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] graceful_shutdown_timeout = 5 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] group_api_class = cinder.group.api.API {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] host = devstack {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_compress_on_upload = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_conversion_address_space_limit = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_conversion_cpu_limit = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_conversion_disable = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_upload_use_cinder_backend = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_upload_use_internal_tenant = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_volume_cache_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_volume_cache_max_count = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] image_volume_cache_max_size_gb = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] init_host_max_objects_retrieval = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] instance_format = [instance: %(uuid)s] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] iscsi_target_flags = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] iscsi_write_cache = on {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] iser_helper = tgtadm {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] iser_ip_address = 192.168.122.192 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] iser_port = 3260 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_color = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_config_append = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_dir = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_options = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_rotate_interval = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_rotate_interval_type = days {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] log_rotation_type = none {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] max_age = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] max_logfile_count = 30 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] max_logfile_size_mb = 200 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] max_over_subscription_ratio = 20.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] message_reap_interval = 86400 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] message_ttl = 2592000 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] migration_create_volume_timeout_secs = 300 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] monkey_patch = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] monkey_patch_modules = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] my_ip = 192.168.122.192 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] no_snapshot_gb_quota = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] num_iser_scan_tries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] num_shell_tries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] num_volume_device_scan_tries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] nvmeof_conn_info_version = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] nvmet_ns_id = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] nvmet_port_id = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_max_limit = 1000 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_volume_ext_list = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_volume_listen = 0.0.0.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_volume_listen_port = 8776 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_volume_use_ssl = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] osapi_volume_workers = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] per_volume_size_limit = -1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] periodic_fuzzy_delay = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] periodic_interval = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] project_id_regex = [0-9a-f\-]+ {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] public_endpoint = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] publish_errors = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_backup_gigabytes = 1000 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_backups = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87729]: INFO cinder.volume.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Starting volume driver QuobyteDriver (1.2) Jul 25 02:30:07 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.remotefs [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87729) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_gigabytes = 1000 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_groups = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_snapshots = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] quota_volumes = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] rate_limit_burst = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] rate_limit_except_level = CRITICAL {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] rate_limit_interval = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] reinit_driver_count = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] replication_device = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] report_discard_supported = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] report_interval = 120 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] reservation_clean_interval = 86400 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] reservation_expire = 86400 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] reserved_image_namespaces = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] reserved_percentage = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] rpc_response_timeout = 120 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] run_external_periodic_tasks = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] scst_target_driver = iscsi {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] scst_target_iqn_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_down_time = 720 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] shell_completion = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] snapshot_name_template = snapshot-%s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] split_loggers = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] state_path = /opt/stack/data/cinder {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] storage_availability_zone = nova {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] storage_protocol = iSCSI {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] syslog_log_facility = LOG_USER {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] target_helper = lioadm {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] target_ip_address = 192.168.122.192 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] target_port = 3260 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] target_protocol = iscsi {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] target_secondary_ip_addresses = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] trace_flags = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] transfer_api_class = cinder.transfer.api.API {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] transport_url = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] until_refresh = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_chap_auth = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_default_quota_class = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_journal = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_json = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_multipath_for_image_xfer = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_stderr = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] use_syslog = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] verify_glance_signatures = enabled {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_api_class = cinder.volume.api.API {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_backend_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_clear = zero {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_clear_ionice = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_clear_size = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_copy_bps_limit = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_dd_blocksize = 1M {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_name_template = volume-%s {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_service_inithost_offload = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volume_usage_audit_period = month {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] zoning_mode = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_concurrency.disable_process_locking = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.auth_section = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.auth_type = password {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.auth_version = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.cache = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.include_service_catalog = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.insecure = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.interface = public {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_password = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcache_username = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.region_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.service_type = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.backend = dogpile.cache.null {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.backend_argument = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.backend_expiration_time = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.config_prefix = cache.oslo {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.debug_cache_backend = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.enable_retry_client = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.enable_socket_keepalive = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.expiration_time = 600 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.hashclient_retry_attempts = 2 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_dead_retry = 300 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_pool_maxsize = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_sasl_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.password = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.proxies = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.redis_db = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.redis_server = localhost:6379 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.retry_attempts = 2 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.retry_delay = 0.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.socket_keepalive_count = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.socket_keepalive_idle = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.socket_keepalive_interval = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.socket_timeout = 1.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.tls_allowed_ciphers = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.tls_cafile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.tls_certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.tls_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.tls_keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cache.username = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] coordination.backend_url = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.asyncio_connection = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.asyncio_slave_connection = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.backend = sqlalchemy {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.connection = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.connection_debug = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:07 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.connection_parameters = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.connection_recycle_time = 3600 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.connection_trace = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.db_inc_retry_interval = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.db_max_retries = 20 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.db_max_retry_interval = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.db_retry_interval = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.max_overflow = 50 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.max_pool_size = 5 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.max_retries = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.mysql_wsrep_sync_wait = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.pool_timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.retry_interval = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.slave_connection = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.sqlite_synchronous = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.synchronous_reader = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] database.use_db_reconnect = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.connection_string = messaging:// {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.es_doc_type = notification {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.es_scroll_size = 10000 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.es_scroll_time = 2m {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.filter_error_trace = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.hmac_keys = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.sentinel_service_name = mymaster {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.socket_timeout = 0.1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.trace_requests = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler.trace_sqlalchemy = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler_jaeger.process_tags = {} {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler_jaeger.service_name_prefix = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] profiler_otlp.service_name_prefix = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.enforce_new_defaults = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.policy_default_rule = default {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.policy_file = policy.yaml {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_policy.remote_timeout = 60.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.group = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.helper_command = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] privsep_osbrick.user = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.group = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.helper_command = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] cinder_sys_admin.user = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.auth_section = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.auth_type = password {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.cafile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.collect_timing = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.insecure = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.send_service_user_token = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.split_loggers = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] service_user.timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.auth_section = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.auth_type = password {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.collect_timing = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.insecure = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.region_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.split_loggers = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] glance.timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.backend_availability_zone = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.chap_password = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.chap_username = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.disk_geometry = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.driver_client_cert = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.driver_client_cert_key = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.driver_data_namespace = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.driver_use_ssl = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.extra_capabilities = {} {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.filter_function = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.goodness_function = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.iscsi_target_flags = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.iscsi_write_cache = on {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.iser_helper = tgtadm {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.iser_port = 3260 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_host = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_login = admin {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_mount_options = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_password = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_private_key = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_share_path = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_ssh_port = 22 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.num_shell_tries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87729) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87729]: WARNING cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 25 02:30:08 devstack cinder-volume[87729]: WARNING cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.quobyte_volume_url = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.replication_device = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.report_discard_supported = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.reserved_percentage = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.target_helper = tgtadm {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.target_port = 3260 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.target_protocol = iscsi {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.trace_flags = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.unique_fqdn_network = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.use_chap_auth = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_backend_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_clear = zero {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_clear_ionice = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_clear_size = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_reports.file_event_handler = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_reports.log_dir = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.backend_availability_zone = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Running cmd (subprocess): mount.quobyte {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.backend_host = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.chap_password = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.chap_username = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.chiscsi_conf = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.disk_geometry = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.driver_client_cert = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.driver_data_namespace = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.driver_use_ssl = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.extra_capabilities = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.filter_function = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.goodness_function = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.iscsi_target_flags = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.iscsi_write_cache = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.iser_helper = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.iser_ip_address = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.iser_port = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.iser_target_prefix = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_host = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_login = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_mount_options = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_password = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_private_key = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_share_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_ssh_port = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.num_shell_tries = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nvmet_ns_id = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.nvmet_port_id = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.replication_device = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.report_discard_supported = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.reserved_percentage = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.scst_target_driver = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.storage_protocol = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.target_helper = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.target_ip_address = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.target_port = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.target_prefix = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.target_protocol = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.trace_flags = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.unique_fqdn_network = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.use_chap_auth = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_clear = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_clear_ionice = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_clear_size = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] QuobyteHD.volumes_dir = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.ssl_version = {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_notifications.driver = [] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_notifications.retry = -1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] key_manager.fixed_key = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.barbican_api_version = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.barbican_endpoint = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.barbican_endpoint_type = public {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.barbican_region_name = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.cafile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.collect_timing = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.insecure = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.number_of_retries = 60 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.retry_delay = 1 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.send_service_user_token = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.split_loggers = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.verify_ssl = True {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican.verify_ssl_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.auth_section = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.auth_type = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.cafile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.certfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.collect_timing = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.insecure = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.keyfile = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.split_loggers = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] barbican_service_user.timeout = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.approle_role_id = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.approle_secret_id = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.auth_method = approle {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.auth_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.kv_mountpoint = secret {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.kv_path = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.kv_version = 2 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.namespace = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.root_token_id = **** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.ssl_ca_crt_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.timeout = 60.0 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.token_file = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.token_role = None {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.use_ssl = False {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:08 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] ******************************************************************************** {{(pid=87510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 25 02:30:08 devstack quobyte-client[87736]: Reading configuration file: /etc/quobyte/client.cfg Jul 25 02:30:08 devstack quobyte-client[87736]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=87729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:30:08 devstack cinder-volume[87729]: INFO cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac ... Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 -c /etc/quobyte/client-cinder.cfg {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:08 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 -c /etc/quobyte/client-cinder.cfg Jul 25 02:30:08 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:08 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.396s {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:08 devstack cinder-volume[87729]: INFO cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac succeeded Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=87729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.413s {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:08 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:30:08 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:08 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.258s {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:08 devstack cinder-volume[87729]: INFO cinder.volume.driver [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Driver hasn't implemented _init_vendor_properties() Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.volume.driver [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87729) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87729) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG dbcounter [-] [87729] Writer thread running {{(pid=87729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.db.api [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Building query based on filter {{(pid=87729) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.image.image_utils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87729) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 25 02:30:08 devstack cinder-volume[87729]: INFO cinder.keymgr.migration [None req-60f50ba8-4974-4510-b87c-5a251f667a0f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:30:08 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=87729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=87729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:09 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:30:09 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:09 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.292s {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG cinder.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Notifying Schedulers of capabilities ... {{(pid=87729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:30:09 devstack cinder-volume[87729]: INFO cinder.volume.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Driver initialization completed successfully. Jul 25 02:30:09 devstack cinder-volume[87729]: INFO cinder.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Initiating service 3 cleanup Jul 25 02:30:09 devstack cinder-volume[87729]: INFO cinder.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Service 3 cleanup completed. Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG cinder.service [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Creating RPC server for service cinder-volume {{(pid=87729) start /opt/stack/cinder/cinder/service.py:231}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG cinder.service [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87729) start /opt/stack/cinder/cinder/service.py:237}} Jul 25 02:30:09 devstack cinder-volume[87729]: INFO cinder.volume.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=87729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG cinder.volume.drivers.quobyte [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=87729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:09 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:30:09 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:09 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:09 devstack cinder-volume[87729]: DEBUG oslo_concurrency.processutils [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.250s {{(pid=87729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:09 devstack cinder-volume[87729]: INFO cinder.volume.manager [None req-7eb27c0f-92f4-44ec-a4de-70c52aefcb15 None None] Driver post RPC initialization completed successfully. Jul 25 02:30:12 devstack cinder-volume[87510]: INFO oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Caught SIGTERM, stopping children Jul 25 02:30:12 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Acquiring lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:30:12 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Acquired lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:30:12 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Releasing lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:30:12 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Stop services. {{(pid=87510) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 25 02:30:12 devstack cinder-volume[87510]: DEBUG oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Killing children. {{(pid=87510) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 25 02:30:12 devstack cinder-volume[87510]: INFO oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Waiting on 1 children to exit Jul 25 02:30:13 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Acquiring lock "singleton_lock" {{(pid=87729) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:30:13 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Acquired lock "singleton_lock" {{(pid=87729) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:30:13 devstack cinder-volume[87729]: DEBUG oslo_concurrency.lockutils [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Releasing lock "singleton_lock" {{(pid=87729) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:30:13 devstack cinder-volume[87729]: WARNING amqp [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 25 02:30:13 devstack cinder-volume[87729]: WARNING amqp [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 25 02:30:13 devstack cinder-volume[87510]: INFO oslo_service.backend._eventlet.service [None req-c1d62054-d622-4576-9e85-141be09b157b None None] Child 87729 exited with status 0 Jul 25 02:30:14 devstack cinder-volume[88003]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 25 02:30:14 devstack cinder-volume[88003]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 25 02:30:14 devstack cinder-volume[88003]: we strongly recommend against using it for new projects. Jul 25 02:30:14 devstack cinder-volume[88003]: If you are already using Eventlet, we recommend migrating to a different Jul 25 02:30:14 devstack cinder-volume[88003]: framework. For more detail see Jul 25 02:30:14 devstack cinder-volume[88003]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 25 02:30:14 devstack cinder-volume[88003]: import eventlet # noqa Jul 25 02:30:16 devstack cinder-volume[88003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 25 02:30:16 devstack cinder-volume[88003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 25 02:30:16 devstack cinder-volume[88003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 25 02:30:17 devstack cinder-volume[88003]: INFO dbcounter [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Registered counter for database cinder Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_db.sqlalchemy.engines [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG dbcounter [-] [88003] Writer thread running {{(pid=88003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 25 02:30:18 devstack cinder-volume[88003]: INFO cinder.rpc [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 25 02:30:18 devstack cinder-volume[88003]: INFO cinder.rpc [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_db.sqlalchemy.engines [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:18 devstack cinder-volume[88003]: INFO cinder.volume.manager [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Determined volume DB was empty at startup. Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG cinder.volume.manager [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88003) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 25 02:30:18 devstack cinder-volume[88003]: WARNING stevedore.named [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 25 02:30:18 devstack cinder-volume[88003]: WARNING castellan.key_manager [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:30:18 devstack cinder-volume[88003]: WARNING cinder.keymgr.conf_key_mgr [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 25 02:30:18 devstack cinder-volume[88003]: INFO cinder.volume.manager [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_db.sqlalchemy.engines [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:18 devstack cinder-volume[88003]: INFO oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Starting 1 workers Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Started child 88279 {{(pid=88003) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Full set of CONF: {{(pid=88003) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] ******************************************************************************** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] Configuration options gathered from: {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] ================================================================================ {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] allow_availability_zone_fallback = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] allow_compression_on_image_upload = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88279]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] allowed_direct_url_schemes = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] api_rate_limit = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] auth_strategy = keystone {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_availability_zone = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_host = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_stats_polling_interval = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backup_api_class = cinder.backup.api.API {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backup_name_template = backup-%s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backup_use_same_host = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backup_use_temp_snapshot = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] chap_password = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] chap_username = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_internal_tenant_project_id = b375f8a96f654f7dbc64c141ec29bd1b {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_internal_tenant_user_id = 01a339c3bc4f46c9a0e9218fd1c97dad {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cluster = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] compression_format = gzip {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] compute_api_class = cinder.compute.nova.API {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] config_dir = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] config_source = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] control_exchange = openstack {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] debug = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] default_availability_zone = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] default_group_type = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] default_volume_type = QuobyteHD {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] disk_geometry = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] driver_client_cert = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] driver_client_cert_key = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] driver_data_namespace = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] driver_ssl_cert_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] driver_ssl_cert_verify = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] driver_use_ssl = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] enable_new_services = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] enable_unsupported_driver = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] enabled_backends = ['QuobyteHD'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] enforce_multipath_for_image_xfer = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] filter_function = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_api_insecure = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_api_ssl_compression = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_ca_certificates_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_catalog_info = image:glance:publicURL {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_num_retries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance_request_timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] goodness_function = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] graceful_shutdown_timeout = 5 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] group_api_class = cinder.group.api.API {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] host = devstack {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Starting volume driver QuobyteDriver (1.2) Jul 25 02:30:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88279) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_compress_on_upload = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_conversion_address_space_limit = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_conversion_cpu_limit = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_conversion_disable = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_upload_use_cinder_backend = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_upload_use_internal_tenant = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_volume_cache_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_volume_cache_max_count = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] image_volume_cache_max_size_gb = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] init_host_max_objects_retrieval = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] instance_format = [instance: %(uuid)s] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] iscsi_target_flags = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] iscsi_write_cache = on {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] iser_helper = tgtadm {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] iser_ip_address = 192.168.122.192 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] iser_port = 3260 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_color = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:18 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_config_append = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_dir = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_options = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_rotate_interval = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_rotate_interval_type = days {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] log_rotation_type = none {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] max_age = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] max_logfile_count = 30 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] max_logfile_size_mb = 200 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] max_over_subscription_ratio = 20.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] message_reap_interval = 86400 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] message_ttl = 2592000 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] migration_create_volume_timeout_secs = 300 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] monkey_patch = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] monkey_patch_modules = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] my_ip = 192.168.122.192 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] no_snapshot_gb_quota = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] num_iser_scan_tries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] num_shell_tries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] num_volume_device_scan_tries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] nvmeof_conn_info_version = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] nvmet_ns_id = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] nvmet_port_id = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_max_limit = 1000 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_volume_ext_list = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_volume_listen_port = 8776 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_volume_use_ssl = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] osapi_volume_workers = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] per_volume_size_limit = -1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] periodic_fuzzy_delay = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] periodic_interval = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] public_endpoint = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88279) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 25 02:30:19 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 25 02:30:19 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Running cmd (subprocess): mount.quobyte {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] publish_errors = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_backup_gigabytes = 1000 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_backups = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_gigabytes = 1000 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_groups = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_snapshots = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] quota_volumes = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] rate_limit_burst = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] rate_limit_except_level = CRITICAL {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] rate_limit_interval = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] reinit_driver_count = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] replication_device = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] report_discard_supported = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] report_interval = 120 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] reservation_clean_interval = 86400 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] reservation_expire = 86400 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] reserved_image_namespaces = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] reserved_percentage = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] rpc_response_timeout = 120 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] run_external_periodic_tasks = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] scst_target_driver = iscsi {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] scst_target_iqn_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_down_time = 720 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] shell_completion = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] snapshot_name_template = snapshot-%s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] split_loggers = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] state_path = /opt/stack/data/cinder {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] storage_availability_zone = nova {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] storage_protocol = iSCSI {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] syslog_log_facility = LOG_USER {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] target_helper = lioadm {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] target_ip_address = 192.168.122.192 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] target_port = 3260 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] target_protocol = iscsi {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] target_secondary_ip_addresses = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] trace_flags = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] transport_url = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] until_refresh = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_chap_auth = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_default_quota_class = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_journal = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_json = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_multipath_for_image_xfer = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_stderr = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] use_syslog = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] verify_glance_signatures = enabled {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_api_class = cinder.volume.api.API {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_backend_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_clear = zero {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_clear_ionice = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_clear_size = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_copy_bps_limit = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_dd_blocksize = 1M {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_name_template = volume-%s {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_service_inithost_offload = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volume_usage_audit_period = month {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] zoning_mode = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_concurrency.disable_process_locking = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.auth_section = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.auth_type = password {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.auth_version = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.cache = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.include_service_catalog = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.insecure = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.interface = public {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_password = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcache_username = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.region_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.service_type = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.backend = dogpile.cache.null {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.backend_argument = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.backend_expiration_time = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.config_prefix = cache.oslo {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.debug_cache_backend = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.enable_retry_client = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.enable_socket_keepalive = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.expiration_time = 600 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.hashclient_retry_attempts = 2 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_dead_retry = 300 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_pool_maxsize = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_sasl_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.password = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.proxies = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.redis_db = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.redis_server = localhost:6379 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.retry_attempts = 2 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.retry_delay = 0.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.socket_keepalive_count = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.socket_keepalive_idle = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.socket_keepalive_interval = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.socket_timeout = 1.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.tls_allowed_ciphers = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.tls_cafile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.tls_certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.tls_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.tls_keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cache.username = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] coordination.backend_url = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.asyncio_connection = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.asyncio_slave_connection = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.backend = sqlalchemy {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.connection = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.connection_debug = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.connection_parameters = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.connection_recycle_time = 3600 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.connection_trace = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.db_inc_retry_interval = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.db_max_retries = 20 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.db_max_retry_interval = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.db_retry_interval = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.max_overflow = 50 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.max_pool_size = 5 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.max_retries = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.mysql_wsrep_sync_wait = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.pool_timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.retry_interval = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.slave_connection = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.sqlite_synchronous = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.synchronous_reader = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] database.use_db_reconnect = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.connection_string = messaging:// {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.es_doc_type = notification {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.es_scroll_size = 10000 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.es_scroll_time = 2m {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.filter_error_trace = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.hmac_keys = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.sentinel_service_name = mymaster {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.socket_timeout = 0.1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.trace_requests = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler.trace_sqlalchemy = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler_jaeger.process_tags = {} {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler_jaeger.service_name_prefix = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] profiler_otlp.service_name_prefix = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.enforce_new_defaults = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.policy_default_rule = default {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.policy_file = policy.yaml {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.group = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.helper_command = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] privsep_osbrick.user = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.group = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.helper_command = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] cinder_sys_admin.user = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.auth_section = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.auth_type = password {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.cafile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.collect_timing = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.insecure = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.send_service_user_token = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.split_loggers = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] service_user.timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.auth_section = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.auth_type = password {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.collect_timing = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.insecure = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.region_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.split_loggers = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] glance.timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.backend_availability_zone = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.chap_password = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.chap_username = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.disk_geometry = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.driver_client_cert = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.driver_client_cert_key = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.driver_data_namespace = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.driver_use_ssl = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.extra_capabilities = {} {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.filter_function = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.goodness_function = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.iscsi_target_flags = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.iscsi_write_cache = on {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.iser_helper = tgtadm {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.iser_port = 3260 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_host = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_login = admin {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_mount_options = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_password = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_private_key = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_share_path = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.num_shell_tries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.quobyte_volume_url = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.replication_device = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.report_discard_supported = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.reserved_percentage = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.target_helper = tgtadm {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.target_port = 3260 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.target_protocol = iscsi {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.trace_flags = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.unique_fqdn_network = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.use_chap_auth = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_backend_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_clear = zero {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_clear_ionice = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_clear_size = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_reports.file_event_handler = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_reports.log_dir = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.backend_availability_zone = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.backend_host = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.chap_password = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.chap_username = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.chiscsi_conf = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.disk_geometry = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.driver_client_cert = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.driver_data_namespace = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.driver_use_ssl = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.extra_capabilities = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.filter_function = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.goodness_function = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.iser_helper = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.iser_ip_address = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.iser_port = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.iser_target_prefix = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_host = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_login = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_mount_options = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_password = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_private_key = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_share_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_ssh_port = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.num_shell_tries = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.nvmet_port_id = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.replication_device = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.report_discard_supported = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.reserved_percentage = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.scst_target_driver = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.storage_protocol = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.target_helper = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.target_ip_address = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.target_port = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.target_prefix = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.target_protocol = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.trace_flags = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.use_chap_auth = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_clear = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_clear_size = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] QuobyteHD.volumes_dir = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_notifications.driver = [] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_notifications.retry = -1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] key_manager.fixed_key = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.barbican_api_version = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.barbican_endpoint = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.barbican_endpoint_type = public {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.barbican_region_name = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.cafile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.collect_timing = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.insecure = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.number_of_retries = 60 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.retry_delay = 1 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.send_service_user_token = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.split_loggers = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.verify_ssl = True {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican.verify_ssl_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.auth_section = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.auth_type = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.cafile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.certfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.collect_timing = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.insecure = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.keyfile = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.split_loggers = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] barbican_service_user.timeout = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.approle_role_id = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.approle_secret_id = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.auth_method = approle {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.auth_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.kv_mountpoint = secret {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.kv_path = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.kv_version = 2 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.namespace = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.root_token_id = **** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.ssl_ca_crt_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.timeout = 60.0 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.token_file = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.token_role = None {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.use_ssl = False {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 25 02:30:19 devstack cinder-volume[88003]: DEBUG oslo_service.backend._eventlet.service [None req-a123cd4a-2980-4908-8d1b-0777fb41cec4 None None] ******************************************************************************** {{(pid=88003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 25 02:30:19 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.491s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:19 devstack cinder-volume[88279]: INFO cinder.volume.driver [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Driver hasn't implemented _init_vendor_properties() Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.volume.driver [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88279) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_db.sqlalchemy.engines [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writer thread running {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.db.api [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Building query based on filter {{(pid=88279) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88279) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:30:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:19 devstack cinder-volume[88279]: INFO cinder.keymgr.migration [None req-822ad1e6-0315-4266-bfe4-392242496a86 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 25 02:30:19 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:30:19 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:20 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:30:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Driver initialization completed successfully. Jul 25 02:30:20 devstack cinder-volume[88279]: INFO cinder.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Initiating service 3 cleanup Jul 25 02:30:20 devstack cinder-volume[88279]: INFO cinder.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Service 3 cleanup completed. Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG cinder.service [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Creating RPC server for service cinder-volume {{(pid=88279) start /opt/stack/cinder/cinder/service.py:231}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG cinder.service [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88279) start /opt/stack/cinder/cinder/service.py:237}} Jul 25 02:30:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:30:20 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:30:20 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:30:20 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Jul 25 02:30:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.440s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:30:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-42c3d95f-f1e1-4c33-97a7-389c121603ca None None] Driver post RPC initialization completed successfully. Jul 25 02:30:28 devstack cinder-volume[88003]: DEBUG dbcounter [-] [88003] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:30:29 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:30:30 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=4 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:30:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:30:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 6 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:30:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Flow 'volume_create_manager' (20837d89-027c-40b5-b5a1-142acb513ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d394490e-f0f5-4694-9728-c75da9b7cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d394490e-f0f5-4694-9728-c75da9b7cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1045731151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b628947-16d7-432e-afa1-625725c1620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3754748dbd4455d8055d6644fd314d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:20Z,use_quota=True,user_id='fb2efcde0983435ab8b31bc1b4f206ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306ae95f-efce-46cf-89d6-b5efbe54103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306ae95f-efce-46cf-89d6-b5efbe54103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95cfccd-737f-475d-b6cc-603bbd1847af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95cfccd-737f-475d-b6cc-603bbd1847af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b628947-16d7-432e-afa1-625725c1620a', 'volume_name': 'volume-8b628947-16d7-432e-afa1-625725c1620a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b166f865-4081-44e1-b378-6c4db11369b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b166f865-4081-44e1-b378-6c4db11369b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ed705c-49b2-4dc9-a025-8e68c0cdb853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Volume 8b628947-16d7-432e-afa1-625725c1620a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b628947-16d7-432e-afa1-625725c1620a', 'volume_size': 1} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1045731151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b628947-16d7-432e-afa1-625725c1620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3754748dbd4455d8055d6644fd314d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:20Z,use_quota=True,user_id='fb2efcde0983435ab8b31bc1b4f206ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Creating volume 8b628947-16d7-432e-afa1-625725c1620a {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:31:20 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:20 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a 1073741824 Jul 25 02:31:20 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Flow 'volume_create_manager' (43b4172b-18e6-4452-b2b9-1ca20ad50728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daca1264-7a7c-4602-8e7a-e809d5b64969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daca1264-7a7c-4602-8e7a-e809d5b64969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1454944944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508d52a7-3dc3-4853-98ec-6d39408a6fcd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e9992aa18134936b264c647f43fb7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:21Z,use_quota=True,user_id='796c32d4867c4ad58c5b38ef716cbf33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d36944-89d9-4411-8a3a-b247e4a9e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d36944-89d9-4411-8a3a-b247e4a9e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe711f7-3bf5-40fe-8663-cc3ea4047d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe711f7-3bf5-40fe-8663-cc3ea4047d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '508d52a7-3dc3-4853-98ec-6d39408a6fcd', 'volume_name': 'volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15373f7-7225-4f6f-936d-ba047199c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15373f7-7225-4f6f-936d-ba047199c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990211c3-4737-4cd7-8bf9-96fadb67d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Volume 508d52a7-3dc3-4853-98ec-6d39408a6fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd', 'volume_size': 1} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:21 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a 1073741824" returned: 0 in 0.598s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:21 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a Jul 25 02:31:21 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:21 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a" returned: 0 in 0.286s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1454944944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508d52a7-3dc3-4853-98ec-6d39408a6fcd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e9992aa18134936b264c647f43fb7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:21Z,use_quota=True,user_id='796c32d4867c4ad58c5b38ef716cbf33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Creating volume 508d52a7-3dc3-4853-98ec-6d39408a6fcd {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:31:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:21 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd 1073741824 Jul 25 02:31:21 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ed705c-49b2-4dc9-a025-8e68c0cdb853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b628947-16d7-432e-afa1-625725c1620a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce506ddd-006f-462a-8433-7a0a68869964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Volume volume-8b628947-16d7-432e-afa1-625725c1620a (8b628947-16d7-432e-afa1-625725c1620a): created successfully Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce506ddd-006f-462a-8433-7a0a68869964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Flow 'volume_create_manager' (20837d89-027c-40b5-b5a1-142acb513ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:21 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dc086186-6a4b-4c32-916f-f17154ea8e18 tempest-DeleteServersTestJSON-940867356 None] Created volume successfully. Jul 25 02:31:22 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd 1073741824" returned: 0 in 0.599s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:22 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd Jul 25 02:31:22 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:22 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990211c3-4737-4cd7-8bf9-96fadb67d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf3c0af-6355-4207-8c5f-b33efda1127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Volume volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd (508d52a7-3dc3-4853-98ec-6d39408a6fcd): created successfully Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf3c0af-6355-4207-8c5f-b33efda1127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Flow 'volume_create_manager' (43b4172b-18e6-4452-b2b9-1ca20ad50728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-c986aff8-d18d-43a8-8ac4-192839bb7020 req-7fe51710-1533-4306-9fc2-3f7b8b687413 tempest-VolumesGetTestJSON-874348318 None] Created volume successfully. Jul 25 02:31:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Acquiring lock "cinder-508d52a7-3dc3-4853-98ec-6d39408a6fcd-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Lock "cinder-508d52a7-3dc3-4853-98ec-6d39408a6fcd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Acquiring lock "cinder-quobyte-508d52a7-3dc3-4853-98ec-6d39408a6fcd" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Lock "cinder-quobyte-508d52a7-3dc3-4853-98ec-6d39408a6fcd" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:23 devstack cinder-volume[88279]: INFO oslo.privsep.daemon [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgz1fozuj/privsep.sock'] Jul 25 02:31:23 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgz1fozuj/privsep.sock Jul 25 02:31:23 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 25 02:31:24 devstack cinder-volume[88279]: WARNING py.warnings [req-04331cd5-20ff-49de-9d92-99b1cf2af5a2 req-7be8d29c-8e6d-4bb1-a59b-068c79ed3186 tempest-DeleteServersTestJSON-940867356 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 25 02:31:24 devstack cinder-volume[88279]: .first() Jul 25 02:31:24 devstack cinder-volume[88279]: Jul 25 02:31:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-04331cd5-20ff-49de-9d92-99b1cf2af5a2 req-7be8d29c-8e6d-4bb1-a59b-068c79ed3186 tempest-DeleteServersTestJSON-940867356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-04331cd5-20ff-49de-9d92-99b1cf2af5a2 req-7be8d29c-8e6d-4bb1-a59b-068c79ed3186 tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-04331cd5-20ff-49de-9d92-99b1cf2af5a2 req-7be8d29c-8e6d-4bb1-a59b-068c79ed3186 tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-04331cd5-20ff-49de-9d92-99b1cf2af5a2 req-7be8d29c-8e6d-4bb1-a59b-068c79ed3186 tempest-DeleteServersTestJSON-940867356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-8b628947-16d7-432e-afa1-625725c1620a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09144d9b-75cb-4541-8224-96e1c1eea367', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:31:24 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:24 devstack cinder-volume[88279]: INFO oslo.privsep.daemon [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Spawned new privsep daemon via rootwrap Jul 25 02:31:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Accepted privsep connection to /tmp/tmpgz1fozuj/privsep.sock {{(pid=88279) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 25 02:31:24 devstack cinder-volume[88279]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 25 02:31:24 devstack cinder-volume[88279]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 25 02:31:24 devstack cinder-volume[88279]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 25 02:31:24 devstack cinder-volume[88279]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89465 Jul 25 02:31:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4758fbcf-e3c0-4684-b532-7f7cb3fda605]: (2,) {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87fefea-4e26-4892-acec-fcd6fff8e23c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-04331cd5-20ff-49de-9d92-99b1cf2af5a2 req-7be8d29c-8e6d-4bb1-a59b-068c79ed3186 tempest-DeleteServersTestJSON-940867356 None] attachment_update completed successfully. Jul 25 02:31:25 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd Jul 25 02:31:25 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:25 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd" returned: 0 in 0.516s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:25 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd Jul 25 02:31:25 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:25 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-508d52a7-3dc3-4853-98ec-6d39408a6fcd" returned: 0 in 0.308s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Lock "cinder-quobyte-508d52a7-3dc3-4853-98ec-6d39408a6fcd" released by "delete_volume" :: held 2.363s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:25 devstack cinder-volume[88279]: WARNING cinder.quota [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:31:25 devstack cinder-volume[88279]: WARNING cinder.quota [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:31:25 devstack cinder-volume[88279]: DEBUG cinder.quota [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Created reservations ['04cadfa1-84f5-4e99-a5f7-82c0d1a85448', '8b83b838-02cb-4f09-adcb-be4b13f422c5', '86da6daa-e45d-44b4-a14c-ccf91e3f39f0', '78b1422c-805b-4976-8ec1-8414634533e8'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:26 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:31:26 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:26 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.469s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG cinder.manager [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:31:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Deleted volume successfully. Jul 25 02:31:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-591a7de3-d16f-40cf-923c-5b5613866ab3 req-9202a634-939f-48aa-af1e-91bea26f5f53 tempest-VolumesGetTestJSON-874348318 None] Lock "cinder-508d52a7-3dc3-4853-98ec-6d39408a6fcd-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:30 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-7267b51e-0337-4c89-a595-437fd9cc5585 req-6e5887b8-778f-4b5d-9be5-763e10cc3887 tempest-DeleteServersTestJSON-940867356 None] Terminate volume connection completed successfully. Jul 25 02:31:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-7267b51e-0337-4c89-a595-437fd9cc5585 req-6e5887b8-778f-4b5d-9be5-763e10cc3887 tempest-DeleteServersTestJSON-940867356 None] Deleting attachment 09144d9b-75cb-4541-8224-96e1c1eea367. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Flow 'volume_create_manager' (2e1efaf0-3c2c-412f-8992-b7089dc0b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccde768b-bfe4-465f-8bce-37170030a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccde768b-bfe4-465f-8bce-37170030a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-849501606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a0e154-c69b-4366-9a05-f0b3351daa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8677571db73240b3b44782f8d00a3c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:31Z,use_quota=True,user_id='d3456bbefa0f4188bc79e9edb401f728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f845d7-01a9-4946-b0c1-9bb4e02cf8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f845d7-01a9-4946-b0c1-9bb4e02cf8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7a17da-79f7-4bbb-8614-20b874b6a14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7a17da-79f7-4bbb-8614-20b874b6a14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a0e154-c69b-4366-9a05-f0b3351daa65', 'volume_name': 'volume-86a0e154-c69b-4366-9a05-f0b3351daa65', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84b0203-6db9-47f3-a5b0-b57173391155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84b0203-6db9-47f3-a5b0-b57173391155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1626e04-eb84-4816-be5b-a881dec29d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Volume 86a0e154-c69b-4366-9a05-f0b3351daa65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a0e154-c69b-4366-9a05-f0b3351daa65', 'volume_size': 1} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-849501606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a0e154-c69b-4366-9a05-f0b3351daa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8677571db73240b3b44782f8d00a3c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:31Z,use_quota=True,user_id='d3456bbefa0f4188bc79e9edb401f728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Creating volume 86a0e154-c69b-4366-9a05-f0b3351daa65 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:31:31 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:31 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 1073741824 Jul 25 02:31:31 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:31 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 1073741824" returned: 0 in 0.622s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:31 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 Jul 25 02:31:31 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:32 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1626e04-eb84-4816-be5b-a881dec29d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a0e154-c69b-4366-9a05-f0b3351daa65', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640805e3-9fd3-4264-9641-0716226a803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Volume volume-86a0e154-c69b-4366-9a05-f0b3351daa65 (86a0e154-c69b-4366-9a05-f0b3351daa65): created successfully Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640805e3-9fd3-4264-9641-0716226a803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Flow 'volume_create_manager' (2e1efaf0-3c2c-412f-8992-b7089dc0b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3f903c90-48e2-4115-b488-f447aa6af9c8 tempest-ServerActionsTestOtherA-686120853 None] Created volume successfully. Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Acquiring lock "cinder-8b628947-16d7-432e-afa1-625725c1620a-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Lock "cinder-8b628947-16d7-432e-afa1-625725c1620a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Acquiring lock "cinder-quobyte-8b628947-16d7-432e-afa1-625725c1620a" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Lock "cinder-quobyte-8b628947-16d7-432e-afa1-625725c1620a" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e2e16d-f833-44c1-ba67-b586aa78f114]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:33 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a Jul 25 02:31:33 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3ca5e293-eb7c-4e73-b51d-f4003047bff3 tempest-GroupSnapshotsTest-171717790 None] Group tempest-GroupSnapshotsTest-Group-1236948108: creating Jul 25 02:31:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3ca5e293-eb7c-4e73-b51d-f4003047bff3 tempest-GroupSnapshotsTest-171717790 None] Group tempest-GroupSnapshotsTest-Group-1236948108: created successfully Jul 25 02:31:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3ca5e293-eb7c-4e73-b51d-f4003047bff3 tempest-GroupSnapshotsTest-171717790 None] Create group completed successfully. Jul 25 02:31:33 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:33 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a Jul 25 02:31:33 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:33 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8b628947-16d7-432e-afa1-625725c1620a" returned: 0 in 0.268s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Lock "cinder-quobyte-8b628947-16d7-432e-afa1-625725c1620a" released by "delete_volume" :: held 0.754s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Created reservations ['6ef02fe9-d1c3-42da-a050-8065cd2c56ca', '112d3068-1938-40ff-9e2a-f9e50bf54740', '8ca6053e-fd77-42d9-837a-4e6f25ce02d2', 'ece4ead4-c222-4ec9-afea-619c8f067a51'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:34 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:31:34 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:34 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:31:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Deleted volume successfully. Jul 25 02:31:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec7e9b85-f3bf-4f5f-98cb-a30064c7474b tempest-DeleteServersTestJSON-940867356 None] Lock "cinder-8b628947-16d7-432e-afa1-625725c1620a-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (cb1886af-a3bd-44b6-b713-bc4b97b2366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f943cf4-0ba9-4f81-8b42-b3db51c7af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f943cf4-0ba9-4f81-8b42-b3db51c7af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-336275328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14837a1a-aca5-45e8-9b8c-191433f93e01,host='devstack@QuobyteHD#QuobyteHD',id=18f87d65-9167-4162-9267-7765b7695fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:35Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(120e1028-a64c-4a04-917b-946c36c9e195),volume_type_id=120e1028-a64c-4a04-917b-946c36c9e195)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d7e465-1e21-46a7-8a8a-4647da6c1bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d7e465-1e21-46a7-8a8a-4647da6c1bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a496132-c1d1-485c-8401-9defa31e3cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a496132-c1d1-485c-8401-9defa31e3cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f87d65-9167-4162-9267-7765b7695fb7', 'volume_name': 'volume-18f87d65-9167-4162-9267-7765b7695fb7', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78783ae7-ecb3-43f7-8e38-b3173e80ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78783ae7-ecb3-43f7-8e38-b3173e80ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42d2bf7-eeef-45b4-b43a-2db42fd22361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:35 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Volume 18f87d65-9167-4162-9267-7765b7695fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f87d65-9167-4162-9267-7765b7695fb7', 'volume_size': 1} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14837a1a-aca5-45e8-9b8c-191433f93e01,created_at=2026-07-25T00:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-336275328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14837a1a-aca5-45e8-9b8c-191433f93e01,host='devstack@QuobyteHD#QuobyteHD',id=18f87d65-9167-4162-9267-7765b7695fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:31:35Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(120e1028-a64c-4a04-917b-946c36c9e195),volume_type_id=120e1028-a64c-4a04-917b-946c36c9e195)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Creating volume 18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:31:35 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:31:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:35 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 1073741824 Jul 25 02:31:35 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:36 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 1073741824" returned: 0 in 0.603s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:36 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:36 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:36 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.303s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42d2bf7-eeef-45b4-b43a-2db42fd22361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f87d65-9167-4162-9267-7765b7695fb7', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d883f1c6-09d5-430c-9231-fe8ab706b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:31:36 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Volume volume-18f87d65-9167-4162-9267-7765b7695fb7 (18f87d65-9167-4162-9267-7765b7695fb7): created successfully Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d883f1c6-09d5-430c-9231-fe8ab706b58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:31:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (cb1886af-a3bd-44b6-b713-bc4b97b2366a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:31:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f7f9ad38-b248-4d73-b39f-a72f2100d1fc tempest-GroupSnapshotsTest-171717790 None] Created volume successfully. Jul 25 02:31:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] GroupSnapshot 4c3da3ae-e3d3-4d62-a153-bb264bc77df8: creating. Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Group snapshot 4c3da3ae-e3d3-4d62-a153-bb264bc77df8: creating. {{(pid=88279) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Creating offline snapshot e26542d8-c3c4-44da-aa01-35a9474969ee of volume 18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfac5d-7f41-457b-a90b-a33a6c5a9e4b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:38 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:38 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:38 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.566s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:38 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee 1G Jul 25 02:31:38 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:39 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee 1G" returned: 0 in 0.476s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f87d65-9167-4162-9267-7765b7695fb7 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:39 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f87d65-9167-4162-9267-7765b7695fb7 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee Jul 25 02:31:39 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:39 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f87d65-9167-4162-9267-7765b7695fb7 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee" returned: 0 in 0.329s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:39 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:31:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:39 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee Jul 25 02:31:39 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:39 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee" returned: 0 in 0.268s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:39 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info Jul 25 02:31:39 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:40 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info" returned: 0 in 0.305s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:40 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:31:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:40 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info Jul 25 02:31:40 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:40 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.info" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1ce563b6-5a6c-40be-bdba-a0a461c92b51 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 4c3da3ae-e3d3-4d62-a153-bb264bc77df8: created successfully Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-e26542d8-c3c4-44da-aa01-35a9474969ee-77b0b496-460d-48d0-a6f8-7b0acbda845a" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-e26542d8-c3c4-44da-aa01-35a9474969ee-77b0b496-460d-48d0-a6f8-7b0acbda845a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Creating volume 77b0b496-460d-48d0-a6f8-7b0acbda845a from snapshot e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-77b0b496-460d-48d0-a6f8-7b0acbda845a" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-77b0b496-460d-48d0-a6f8-7b0acbda845a" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] snapshot: e26542d8-c3c4-44da-aa01-35a9474969ee, volume: 77b0b496-460d-48d0-a6f8-7b0acbda845a, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff6aee-a8b5-45c7-8b2c-312a650496dc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:42 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee Jul 25 02:31:42 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:43 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee" returned: 0 in 0.618s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f87d65-9167-4162-9267-7765b7695fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2cab47-f549-4665-a820-f4c8f17df852]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:43 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:43 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:43 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.577s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:44 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:31:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:44 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a Jul 25 02:31:44 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:50 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:31:50 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:51 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:31:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:31:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 8 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:31:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:31:52 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a" returned: 0 in 8.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d8b3bf-2435-4764-b0b1-a4eb6bb9d34c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=36,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=7 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:31:52 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:52 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=35,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:31:53 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.774s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:31:53 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Converted 1024.00 MB image at 121.53 MB/s Jul 25 02:31:53 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:53 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a Jul 25 02:31:53 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:53 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-77b0b496-460d-48d0-a6f8-7b0acbda845a" released by "_copy_volume_from_snapshot" :: held 10.960s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-e26542d8-c3c4-44da-aa01-35a9474969ee-77b0b496-460d-48d0-a6f8-7b0acbda845a" released by "_create_volume_from_snapshot" :: held 11.028s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.049s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:53 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-740d2543-cf15-4ee3-9820-14239510b161 tempest-GroupSnapshotsTest-171717790 None] Create group from source-snapshot-4c3da3ae-e3d3-4d62-a153-bb264bc77df8 completed successfully. Jul 25 02:31:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-77b0b496-460d-48d0-a6f8-7b0acbda845a" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-77b0b496-460d-48d0-a6f8-7b0acbda845a" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:54 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b95036-8222-4adc-8d5e-3e18ef82582d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:55 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a Jul 25 02:31:55 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:55 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a" returned: 0 in 0.556s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:55 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a Jul 25 02:31:55 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:55 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-77b0b496-460d-48d0-a6f8-7b0acbda845a" returned: 0 in 0.337s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-77b0b496-460d-48d0-a6f8-7b0acbda845a" released by "delete_volume" :: held 0.960s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:55 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Created reservations ['539ae99c-9bd6-4417-9b09-141b2b56f504'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:31:55 devstack cinder-volume[88279]: WARNING cinder.quota [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1321332877 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1321332877, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:31:55 devstack cinder-volume[88279]: WARNING cinder.quota [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1321332877 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1321332877, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:31:55 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Created reservations ['6f01d03a-ec1a-4943-85ad-3ba7d1af538e', '59563a9c-d381-4fd1-af10-0fa34a01b993', '01da0639-0d84-4bee-b398-34bcec14edec', 'cbc61a75-070b-4367-bf36-f11a4ba38614'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:56 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:31:56 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 4c3da3ae-e3d3-4d62-a153-bb264bc77df8: deleting Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 4c3da3ae-e3d3-4d62-a153-bb264bc77df8: deleting {{(pid=88279) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-18f87d65-9167-4162-9267-7765b7695fb7" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-18f87d65-9167-4162-9267-7765b7695fb7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-e26542d8-c3c4-44da-aa01-35a9474969ee" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-e26542d8-c3c4-44da-aa01-35a9474969ee" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Deleting offline snapshot e26542d8-c3c4-44da-aa01-35a9474969ee of volume 18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:31:56 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] snapshot_file for this snap is: volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.395s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:31:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-eb1fa9ec-1fd3-4556-8ed9-90b23db4a19f tempest-GroupSnapshotsTest-171717790 None] Delete group completed successfully. Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027b292-5c34-4c3c-808e-de752d044824]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:56 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee Jul 25 02:31:56 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:57 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee" returned: 0 in 0.569s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f87d65-9167-4162-9267-7765b7695fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c2d8c-e23e-4772-a1d3-888559871ccd]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:57 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:57 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:57 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.476s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:57 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee Jul 25 02:31:57 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:57 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee" returned: 0 in 0.405s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:58 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee Jul 25 02:31:58 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:58 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7.e26542d8-c3c4-44da-aa01-35a9474969ee" returned: 0 in 0.288s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-e26542d8-c3c4-44da-aa01-35a9474969ee" released by "_delete_snapshot" :: held 1.894s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-18f87d65-9167-4162-9267-7765b7695fb7" released by "delete_snapshot" :: held 1.936s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:31:58 devstack cinder-volume[88279]: WARNING cinder.quota [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1321332877 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1321332877, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:31:58 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['f782bcb2-e024-4c5d-b78e-2e9761a3e70a', '77403166-d607-47db-a5dc-1e46b2f65536', '10e1d020-94c6-4682-9b13-71a8bcec572e', '2d2ac01a-c145-49df-8cc0-284848b8ff4e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:31:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-48e2965f-0fea-49fb-802a-553069871c08 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 4c3da3ae-e3d3-4d62-a153-bb264bc77df8: deleted successfully Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-18f87d65-9167-4162-9267-7765b7695fb7" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-18f87d65-9167-4162-9267-7765b7695fb7" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210c394-b26e-4e57-ab8e-3fb5bc67e795]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:59 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:59 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:59 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.437s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:31:59 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7 Jul 25 02:31:59 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:31:59 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-18f87d65-9167-4162-9267-7765b7695fb7" returned: 0 in 0.363s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:31:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-18f87d65-9167-4162-9267-7765b7695fb7" released by "delete_volume" :: held 0.880s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['af458e9e-a226-48c9-a452-d67a96bd69d4'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:00 devstack cinder-volume[88279]: WARNING cinder.db.api [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1321332877'] Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['403adb98-30fc-40d2-ba3c-9d9b18473c45', '62099c51-0969-4c8e-8579-ce529f454ed1', '47488b26-4fdc-4843-a664-3f9eef6848e8', 'afad68ac-0219-44d9-b1cb-601599cc1adb'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:00 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:00 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:00 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:00 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-942ecd14-9dc6-483e-8fa0-50f8646f1cf3 tempest-GroupSnapshotsTest-171717790 None] Delete group completed successfully. Jul 25 02:32:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0fdb8986-13a7-45de-a6fd-77c0f999e47e tempest-GroupSnapshotsTest-171717790 None] Group tempest-GroupSnapshotsTest-Group-1327188749: creating Jul 25 02:32:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0fdb8986-13a7-45de-a6fd-77c0f999e47e tempest-GroupSnapshotsTest-171717790 None] Group tempest-GroupSnapshotsTest-Group-1327188749: created successfully Jul 25 02:32:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0fdb8986-13a7-45de-a6fd-77c0f999e47e tempest-GroupSnapshotsTest-171717790 None] Create group completed successfully. Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (71eeebe2-589a-4f1a-8ba8-6e775492cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036f858c-38de-4960-a868-daadf1a3ad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036f858c-38de-4960-a868-daadf1a3ad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-763578385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e6dfed2-1279-4fbd-8a17-55d6fa49aa72,host='devstack@QuobyteHD#QuobyteHD',id=9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:03Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3),volume_type_id=988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81fa625-e339-409f-8606-47362d3eb3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81fa625-e339-409f-8606-47362d3eb3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f12a17c-95c0-44bb-accc-c40bd727e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f12a17c-95c0-44bb-accc-c40bd727e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3', 'volume_name': 'volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93de269-1e1b-4d93-917c-0e87af8668a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93de269-1e1b-4d93-917c-0e87af8668a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27ddf0f-4eb5-4185-abf6-e531702bf7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Volume 9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3', 'volume_size': 1} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e6dfed2-1279-4fbd-8a17-55d6fa49aa72,created_at=2026-07-25T00:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-763578385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e6dfed2-1279-4fbd-8a17-55d6fa49aa72,host='devstack@QuobyteHD#QuobyteHD',id=9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:03Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3),volume_type_id=988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Creating volume 9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:32:02 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:32:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:02 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 1073741824 Jul 25 02:32:02 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:03 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 1073741824" returned: 0 in 0.514s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:03 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 Jul 25 02:32:03 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:03 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" returned: 0 in 0.293s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27ddf0f-4eb5-4185-abf6-e531702bf7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d107314f-adff-41c9-a391-465c6105be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Volume volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 (9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3): created successfully Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d107314f-adff-41c9-a391-465c6105be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (71eeebe2-589a-4f1a-8ba8-6e775492cd56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dfb7cd8a-ba3e-40d0-acb5-211dd962371d tempest-GroupSnapshotsTest-171717790 None] Created volume successfully. Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (505a6ad8-d9aa-4045-943e-1b58f22aa756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e5ad29-5d27-42d9-a564-9d040808119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e5ad29-5d27-42d9-a564-9d040808119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1460948964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e6dfed2-1279-4fbd-8a17-55d6fa49aa72,host='devstack@QuobyteHD#QuobyteHD',id=074e0e1b-9e9f-4b47-af32-56ac80794933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:05Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3),volume_type_id=988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e3417e-6346-4020-9faa-b66a3c82c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e3417e-6346-4020-9faa-b66a3c82c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880c23cb-a916-49d9-8d4b-a003f7a7d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880c23cb-a916-49d9-8d4b-a003f7a7d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074e0e1b-9e9f-4b47-af32-56ac80794933', 'volume_name': 'volume-074e0e1b-9e9f-4b47-af32-56ac80794933', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851ce15c-3141-4fce-86a3-e3464ba97e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851ce15c-3141-4fce-86a3-e3464ba97e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093e5e94-12d6-478b-8592-ee5a80c9f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Volume 074e0e1b-9e9f-4b47-af32-56ac80794933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074e0e1b-9e9f-4b47-af32-56ac80794933', 'volume_size': 1} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e6dfed2-1279-4fbd-8a17-55d6fa49aa72,created_at=2026-07-25T00:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1460948964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e6dfed2-1279-4fbd-8a17-55d6fa49aa72,host='devstack@QuobyteHD#QuobyteHD',id=074e0e1b-9e9f-4b47-af32-56ac80794933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:05Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3),volume_type_id=988723c3-b3b3-4b16-8a6d-cbc08bf2b8b3)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Creating volume 074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:32:04 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:32:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:04 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 1073741824 Jul 25 02:32:04 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:05 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 1073741824" returned: 0 in 0.695s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:05 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 Jul 25 02:32:05 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:05 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933" returned: 0 in 0.322s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093e5e94-12d6-478b-8592-ee5a80c9f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074e0e1b-9e9f-4b47-af32-56ac80794933', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217d0d47-5c58-4e33-a5ae-3bc04756f97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:05 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Volume volume-074e0e1b-9e9f-4b47-af32-56ac80794933 (074e0e1b-9e9f-4b47-af32-56ac80794933): created successfully Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217d0d47-5c58-4e33-a5ae-3bc04756f97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (505a6ad8-d9aa-4045-943e-1b58f22aa756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-27c30c34-9785-449a-a895-1b9bef7cae0a tempest-GroupSnapshotsTest-171717790 None] Created volume successfully. Jul 25 02:32:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-64ab6763-7388-4e98-844a-72591515a187 tempest-GroupSnapshotsTest-171717790 None] Update group completed successfully. Jul 25 02:32:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6a6898c7-6ef6-48ca-bd33-53efee486d5e tempest-GroupSnapshotsTest-171717790 None] Update group completed successfully. Jul 25 02:32:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d07673f2-f1ba-4337-9c15-865ab0d8e5b7 tempest-GroupSnapshotsTest-171717790 None] Update group completed successfully. Jul 25 02:32:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-34d058e6-0d7e-45d6-8667-3bc569fd06f0 req-649d3e22-6bdf-4cf6-9d8b-f30d766bae66 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-34d058e6-0d7e-45d6-8667-3bc569fd06f0 req-649d3e22-6bdf-4cf6-9d8b-f30d766bae66 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-34d058e6-0d7e-45d6-8667-3bc569fd06f0 req-649d3e22-6bdf-4cf6-9d8b-f30d766bae66 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-34d058e6-0d7e-45d6-8667-3bc569fd06f0 req-649d3e22-6bdf-4cf6-9d8b-f30d766bae66 tempest-ServerActionsTestOtherA-686120853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-86a0e154-c69b-4366-9a05-f0b3351daa65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adc3178d-579f-4a4b-8144-90c5cf1b21a3', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:32:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-34d058e6-0d7e-45d6-8667-3bc569fd06f0 req-649d3e22-6bdf-4cf6-9d8b-f30d766bae66 tempest-ServerActionsTestOtherA-686120853 None] attachment_update completed successfully. Jul 25 02:32:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-127987a4-f990-490a-bc17-e85de7d81906 tempest-GroupSnapshotsTest-171717790 None] Update group completed successfully. Jul 25 02:32:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] GroupSnapshot ae4935ed-8cdf-4328-8989-5859f3f2b0b6: creating. Jul 25 02:32:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Group snapshot ae4935ed-8cdf-4328-8989-5859f3f2b0b6: creating. {{(pid=88279) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 25 02:32:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Creating offline snapshot 5e2f7b5e-8f8d-4559-b871-536a51c5c119 of volume 9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:32:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dcffdd-f3f5-4be3-adc6-f4bee9666f43]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:13 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 Jul 25 02:32:13 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:13 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:13 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 1G Jul 25 02:32:13 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:13 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 1G" returned: 0 in 0.551s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:13 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 Jul 25 02:32:13 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:14 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119" returned: 0 in 0.334s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:14 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:32:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:14 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 Jul 25 02:32:14 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:14 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:14 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info Jul 25 02:32:14 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:14 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:14 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:32:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:14 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info Jul 25 02:32:14 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:15 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.info" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Creating offline snapshot 99adf5ed-ff71-4719-ab3a-9e227e0410ad of volume 074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed303d-10d1-4aaa-9b4e-a19661476846]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:15 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 Jul 25 02:32:15 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:15 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933" returned: 0 in 0.455s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:15 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad 1G Jul 25 02:32:15 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:16 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad 1G" returned: 0 in 0.540s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074e0e1b-9e9f-4b47-af32-56ac80794933 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:16 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074e0e1b-9e9f-4b47-af32-56ac80794933 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad Jul 25 02:32:16 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:16 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074e0e1b-9e9f-4b47-af32-56ac80794933 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad" returned: 0 in 0.418s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:16 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:32:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:16 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad Jul 25 02:32:16 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:17 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:17 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info Jul 25 02:32:17 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:17 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:17 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:32:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:17 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info Jul 25 02:32:17 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:17 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.info" returned: 0 in 0.480s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b5447cdb-1398-4296-ad0e-93573362be53 tempest-GroupSnapshotsTest-171717790 None] group_snapshot ae4935ed-8cdf-4328-8989-5859f3f2b0b6: created successfully Jul 25 02:32:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] group_snapshot ae4935ed-8cdf-4328-8989-5859f3f2b0b6: deleting Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] group_snapshot ae4935ed-8cdf-4328-8989-5859f3f2b0b6: deleting {{(pid=88279) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-5e2f7b5e-8f8d-4559-b871-536a51c5c119" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-5e2f7b5e-8f8d-4559-b871-536a51c5c119" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Deleting offline snapshot 5e2f7b5e-8f8d-4559-b871-536a51c5c119 of volume 9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] snapshot_file for this snap is: volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e7807-6079-4143-89fc-d8c9735e75e0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:19 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 Jul 25 02:32:19 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-9be33c32-82dc-4a36-a62a-f9461e076bb7 tempest-ServerActionsTestOtherA-686120853 None] Terminate volume connection completed successfully. Jul 25 02:32:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-9be33c32-82dc-4a36-a62a-f9461e076bb7 tempest-ServerActionsTestOtherA-686120853 None] Deleting attachment adc3178d-579f-4a4b-8144-90c5cf1b21a3. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:32:19 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119" returned: 0 in 0.592s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:32:19 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f5ca42-f8bf-4f36-b2d0-66d65eacef5d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:19 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 Jul 25 02:32:19 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:20 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" returned: 0 in 0.527s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:20 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 Jul 25 02:32:20 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-30381212-f410-41b8-b108-2e15063a9451 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-30381212-f410-41b8-b108-2e15063a9451 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-30381212-f410-41b8-b108-2e15063a9451 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-30381212-f410-41b8-b108-2e15063a9451 tempest-ServerActionsTestOtherA-686120853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-86a0e154-c69b-4366-9a05-f0b3351daa65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ba400fe-b06f-4bbc-8db4-bc39313a3cf3', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:32:20 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119" returned: 0 in 0.451s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-4cf2539c-07ba-4176-9faf-e88ea2da8e54 req-30381212-f410-41b8-b108-2e15063a9451 tempest-ServerActionsTestOtherA-686120853 None] attachment_update completed successfully. Jul 25 02:32:20 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119 Jul 25 02:32:20 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:20 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3.5e2f7b5e-8f8d-4559-b871-536a51c5c119" returned: 0 in 0.396s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-5e2f7b5e-8f8d-4559-b871-536a51c5c119" released by "_delete_snapshot" :: held 2.162s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" released by "delete_snapshot" :: held 2.221s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-074e0e1b-9e9f-4b47-af32-56ac80794933" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-074e0e1b-9e9f-4b47-af32-56ac80794933" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-99adf5ed-ff71-4719-ab3a-9e227e0410ad" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-99adf5ed-ff71-4719-ab3a-9e227e0410ad" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Deleting offline snapshot 99adf5ed-ff71-4719-ab3a-9e227e0410ad of volume 074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] snapshot_file for this snap is: volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a14010-ae2d-4a75-be29-4aca04dc33b8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:21 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad Jul 25 02:32:21 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Flow 'volume_create_manager' (40bb66bd-1cae-4851-9691-7f7a26a3eb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4863ef4-8d7b-4466-916d-50033767bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4863ef4-8d7b-4466-916d-50033767bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1670563934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b3a0e4-75fc-4d64-b5f1-313f0a43ea75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5425b17d008b4c9cabfee17b84dce0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:21Z,use_quota=True,user_id='7415b87086694fce8951ad88129ec594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cbd010-58ad-455c-b789-df5094cbf33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cbd010-58ad-455c-b789-df5094cbf33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b990d765-def0-4411-8a8e-06d3fa1ba80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b990d765-def0-4411-8a8e-06d3fa1ba80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b3a0e4-75fc-4d64-b5f1-313f0a43ea75', 'volume_name': 'volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:21 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb8db94-16cd-4e34-8195-4ba4040fc625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb8db94-16cd-4e34-8195-4ba4040fc625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6a9d3-88e3-42c1-9aba-051507467c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Volume 20b3a0e4-75fc-4d64-b5f1-313f0a43ea75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75', 'volume_size': 1} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1670563934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b3a0e4-75fc-4d64-b5f1-313f0a43ea75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5425b17d008b4c9cabfee17b84dce0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:21Z,use_quota=True,user_id='7415b87086694fce8951ad88129ec594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Creating volume 20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:32:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad" returned: 0 in 0.602s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074e0e1b-9e9f-4b47-af32-56ac80794933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:32:21 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 1073741824 Jul 25 02:32:21 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cbb081-beea-40ed-9b6f-f6266e0fa0a2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:21 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 Jul 25 02:32:22 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:22 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933" returned: 0 in 0.648s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:22 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad Jul 25 02:32:22 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:22 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 1073741824" returned: 0 in 0.884s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:22 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 Jul 25 02:32:22 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:22 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:22 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad" returned: 0 in 0.490s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:22 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6a9d3-88e3-42c1-9aba-051507467c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:22 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1025e446-fbd0-40ea-9497-14269ec08ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:23 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Volume volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 (20b3a0e4-75fc-4d64-b5f1-313f0a43ea75): created successfully Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1025e446-fbd0-40ea-9497-14269ec08ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Flow 'volume_create_manager' (40bb66bd-1cae-4851-9691-7f7a26a3eb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1101204c-2980-44ba-8b2c-718e22c41608 tempest-TaggedAttachmentsTest-1565778566 None] Created volume successfully. Jul 25 02:32:23 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933.99adf5ed-ff71-4719-ab3a-9e227e0410ad" returned: 0 in 0.365s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-99adf5ed-ff71-4719-ab3a-9e227e0410ad" released by "_delete_snapshot" :: held 2.317s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-074e0e1b-9e9f-4b47-af32-56ac80794933" released by "delete_snapshot" :: held 2.354s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:23 devstack cinder-volume[88279]: WARNING cinder.quota [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1249063971 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1249063971, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:32:23 devstack cinder-volume[88279]: WARNING cinder.quota [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1249063971 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1249063971, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['4a6cd8c6-14ab-45ef-b7cc-386b6d77dab2', '6c0e8b67-5f58-4785-ab0c-2b0fe75205f1', '2b015a6f-15e0-426a-8255-64ea613beb20', '892e7006-1933-4f18-8cd0-c89f3c292d9e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:23 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['7d612878-5bb2-4980-b830-957e94b36156', 'ded4ef43-2eab-4e0e-85c2-8892978c54d8', '5b6c76d6-89e5-464e-b00a-cf9c9e42bc50', '76fcf6c1-713c-40b8-b555-521e9b35d1a8'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1387f94a-cd87-4c53-9fd6-4074e60506e3 tempest-GroupSnapshotsTest-171717790 None] group_snapshot ae4935ed-8cdf-4328-8989-5859f3f2b0b6: deleted successfully Jul 25 02:32:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-074e0e1b-9e9f-4b47-af32-56ac80794933" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-074e0e1b-9e9f-4b47-af32-56ac80794933" acquired by "delete_volume" :: waited 0.041s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:25 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5d8362-31c2-4dba-88a2-3ec88664bd51]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:25 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 Jul 25 02:32:25 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:26 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933" returned: 0 in 0.903s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:26 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933 Jul 25 02:32:26 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:26 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-074e0e1b-9e9f-4b47-af32-56ac80794933" returned: 0 in 0.460s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-074e0e1b-9e9f-4b47-af32-56ac80794933" released by "delete_volume" :: held 1.499s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af1a2a-d388-4a13-9e14-1f5acc9facb8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:26 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 Jul 25 02:32:26 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:27 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" returned: 0 in 0.546s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:27 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3 Jul 25 02:32:27 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:27 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" returned: 0 in 0.372s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-9a9fce97-bc0b-4e4a-a8c6-d11c53bf61c3" released by "delete_volume" :: held 1.040s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['487987a7-0e24-4971-94b4-5d101cc23115'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:27 devstack cinder-volume[88279]: WARNING cinder.quota [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1249063971 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1249063971, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['279bea82-b281-42be-aca0-ece234878814', '923c9ab6-4ebc-40d9-af24-1727240cffe1', '3540dab7-09b0-4c2e-889f-23c7650c76a0', 'ed49c469-48ab-457c-96eb-a523466f5703'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['f49567f0-c240-48f1-8248-43ce95fc25d7', '25c8ac7c-41f7-4874-b98a-5e8eb4403f41', '5eef26fc-a395-4685-a456-a17f86377bbe', 'c302a5d7-4fa3-4b5e-a4c2-36b23f32bb66'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:28 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:28 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:28 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.446s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:28 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:28 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5dead2fd-0174-4fe1-b2bc-d0c0328de834 tempest-GroupSnapshotsTest-171717790 None] Delete group completed successfully. Jul 25 02:32:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-59e21abc-5376-453e-9ff3-9720a96fd5aa tempest-GroupSnapshotsTest-171717790 None] Group tempest-GroupSnapshotsTest-Group-520158478: creating Jul 25 02:32:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-59e21abc-5376-453e-9ff3-9720a96fd5aa tempest-GroupSnapshotsTest-171717790 None] Group tempest-GroupSnapshotsTest-Group-520158478: created successfully Jul 25 02:32:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-59e21abc-5376-453e-9ff3-9720a96fd5aa tempest-GroupSnapshotsTest-171717790 None] Create group completed successfully. Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (31a58ec3-8d80-4f87-9b8b-5cf97adc907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436353a0-e197-48bb-a63e-60cd4698ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436353a0-e197-48bb-a63e-60cd4698ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1544954796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=610fddcb-9fae-4b93-8c1c-854f4ff9c814,host='devstack@QuobyteHD#QuobyteHD',id=909f26ac-e271-4955-ad75-43102f6650f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:31Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17b60f4c-de09-4d18-acaf-eb7dc557e96f),volume_type_id=17b60f4c-de09-4d18-acaf-eb7dc557e96f)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6c24fa-fe45-44ae-892f-659cef7e1c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6c24fa-fe45-44ae-892f-659cef7e1c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23f240f-58ae-41aa-9185-32f9c496b8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23f240f-58ae-41aa-9185-32f9c496b8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909f26ac-e271-4955-ad75-43102f6650f8', 'volume_name': 'volume-909f26ac-e271-4955-ad75-43102f6650f8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd88ac10-283c-481e-8117-93f7f42ebe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd88ac10-283c-481e-8117-93f7f42ebe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2361bd41-097f-44bc-9021-60989102e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Volume 909f26ac-e271-4955-ad75-43102f6650f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909f26ac-e271-4955-ad75-43102f6650f8', 'volume_size': 1} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=610fddcb-9fae-4b93-8c1c-854f4ff9c814,created_at=2026-07-25T00:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1544954796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=610fddcb-9fae-4b93-8c1c-854f4ff9c814,host='devstack@QuobyteHD#QuobyteHD',id=909f26ac-e271-4955-ad75-43102f6650f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b5ebe35c74d43a4464fb13e9229d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:31Z,use_quota=True,user_id='af29f8f030e047e58751b2465012df56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17b60f4c-de09-4d18-acaf-eb7dc557e96f),volume_type_id=17b60f4c-de09-4d18-acaf-eb7dc557e96f)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Creating volume 909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:32:31 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:32:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:31 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 1073741824 Jul 25 02:32:31 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:32 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 1073741824" returned: 0 in 0.736s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:32 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 Jul 25 02:32:32 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:32 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8" returned: 0 in 0.401s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2361bd41-097f-44bc-9021-60989102e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909f26ac-e271-4955-ad75-43102f6650f8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e5b6da-da87-4d5d-9ccc-15ac0ab17b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Volume volume-909f26ac-e271-4955-ad75-43102f6650f8 (909f26ac-e271-4955-ad75-43102f6650f8): created successfully Jul 25 02:32:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e5b6da-da87-4d5d-9ccc-15ac0ab17b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Flow 'volume_create_manager' (31a58ec3-8d80-4f87-9b8b-5cf97adc907a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f947b33c-f4fe-4c92-a154-93bfadae8557 tempest-GroupSnapshotsTest-171717790 None] Created volume successfully. Jul 25 02:32:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] GroupSnapshot 5b4206da-f4eb-4d50-b017-732a2dd23803: creating. Jul 25 02:32:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Group snapshot 5b4206da-f4eb-4d50-b017-732a2dd23803: creating. {{(pid=88279) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 25 02:32:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Creating offline snapshot 9d02d95d-d57c-4633-a8da-5bf50b7458d8 of volume 909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:32:35 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04fd6ea-0cf6-4165-8dc1-de63bbe93588]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:35 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 Jul 25 02:32:35 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:35 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8" returned: 0 in 0.497s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:35 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 1G Jul 25 02:32:35 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:36 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 1G" returned: 0 in 0.544s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909f26ac-e271-4955-ad75-43102f6650f8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:36 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909f26ac-e271-4955-ad75-43102f6650f8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 Jul 25 02:32:36 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:36 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909f26ac-e271-4955-ad75-43102f6650f8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8" returned: 0 in 0.438s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:36 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:32:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:36 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 Jul 25 02:32:36 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:36 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8" returned: 0 in 0.437s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:37 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info Jul 25 02:32:37 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:37 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info" returned: 0 in 0.654s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:37 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:32:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:37 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info Jul 25 02:32:37 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:38 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.info" returned: 0 in 0.821s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.504s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c9f18c63-bd77-4432-a696-0226f745f59e tempest-GroupSnapshotsTest-171717790 None] group_snapshot 5b4206da-f4eb-4d50-b017-732a2dd23803: created successfully Jul 25 02:32:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 5b4206da-f4eb-4d50-b017-732a2dd23803: deleting Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 5b4206da-f4eb-4d50-b017-732a2dd23803: deleting {{(pid=88279) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-909f26ac-e271-4955-ad75-43102f6650f8" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-909f26ac-e271-4955-ad75-43102f6650f8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-9d02d95d-d57c-4633-a8da-5bf50b7458d8" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-9d02d95d-d57c-4633-a8da-5bf50b7458d8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Deleting offline snapshot 9d02d95d-d57c-4633-a8da-5bf50b7458d8 of volume 909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] snapshot_file for this snap is: volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[982629af-4943-4506-b2d2-09ea15dc4e26]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:40 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 Jul 25 02:32:40 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:40 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8" returned: 0 in 0.420s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909f26ac-e271-4955-ad75-43102f6650f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:32:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3645b603-3979-48bb-b34e-3b73aceae096]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:40 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 Jul 25 02:32:40 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:40 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8" returned: 0 in 0.416s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:40 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 Jul 25 02:32:40 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:41 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8" returned: 0 in 0.417s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:41 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8 Jul 25 02:32:41 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:41 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8.9d02d95d-d57c-4633-a8da-5bf50b7458d8" returned: 0 in 0.341s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-9d02d95d-d57c-4633-a8da-5bf50b7458d8" released by "_delete_snapshot" :: held 1.744s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-909f26ac-e271-4955-ad75-43102f6650f8" released by "delete_snapshot" :: held 1.783s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:41 devstack cinder-volume[88279]: WARNING cinder.quota [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1232447630 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1232447630, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:32:41 devstack cinder-volume[88279]: WARNING cinder.quota [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1232447630 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1232447630, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:32:41 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['8f94331d-651d-48a4-8b19-502af476ffc8', 'c3d3170e-4ef3-453d-a424-a7b5048ac258', '7e43de4d-40d4-47f6-849d-c89a0dd16770', '799b3f80-8668-4a9e-ac53-34f3b191950e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8671bfde-cc96-4636-8e92-f48bec809109 tempest-GroupSnapshotsTest-171717790 None] group_snapshot 5b4206da-f4eb-4d50-b017-732a2dd23803: deleted successfully Jul 25 02:32:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "cinder-quobyte-909f26ac-e271-4955-ad75-43102f6650f8" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-909f26ac-e271-4955-ad75-43102f6650f8" acquired by "delete_volume" :: waited 0.040s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b78e6-5c2a-4ca3-bb3d-b859c7fce85b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:43 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 Jul 25 02:32:43 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Flow 'volume_create_manager' (b0e3130c-5935-4c27-bed6-a402f1f20e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39c5bd-c11a-4be3-8016-153c2ab2b3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39c5bd-c11a-4be3-8016-153c2ab2b3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-379729416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047aef3e1243403cb92dfacd9af72d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:43Z,use_quota=True,user_id='6289a851139d4630b9e914aa7ff1b579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419ab1a9-28c6-493c-9b6d-0583c309e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419ab1a9-28c6-493c-9b6d-0583c309e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445488f8-7c1b-42d3-a58b-f8fab30b875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445488f8-7c1b-42d3-a58b-f8fab30b875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b', 'volume_name': 'volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fbba5c-0121-4c09-9f35-0572473849b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fbba5c-0121-4c09-9f35-0572473849b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66ed215-a259-4b87-839b-3abc286a312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:43 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Volume 54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b', 'volume_size': 1} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-379729416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047aef3e1243403cb92dfacd9af72d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:32:43Z,use_quota=True,user_id='6289a851139d4630b9e914aa7ff1b579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Creating volume 54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:32:43 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:43 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b 1073741824 Jul 25 02:32:43 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:43 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8" returned: 0 in 0.806s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:43 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8 Jul 25 02:32:43 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:43 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-909f26ac-e271-4955-ad75-43102f6650f8" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Lock "cinder-quobyte-909f26ac-e271-4955-ad75-43102f6650f8" released by "delete_volume" :: held 1.340s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['d4e7fc3b-be8f-4198-b50a-0a266fbb5b11'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:44 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b 1073741824" returned: 0 in 0.859s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:44 devstack cinder-volume[88279]: WARNING cinder.quota [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1232447630 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1232447630, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Created reservations ['aecad003-44d3-47e6-ba8f-4ce22641099a', '32f8da9e-6224-48dc-93c3-f87960c61748', '8bf649d0-5076-40b9-adfd-457fa0499b08', '77ee9a72-d41f-4cd2-80ba-2f0088afb231'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:44 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b Jul 25 02:32:44 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:44 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:44 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:44 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b" returned: 0 in 0.492s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66ed215-a259-4b87-839b-3abc286a312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1d81c6-c266-49f9-a233-2656a277eb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:32:44 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.322s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-20bf0ac3-e06c-4169-a94f-b9b499c275d8 tempest-GroupSnapshotsTest-171717790 None] Delete group completed successfully. Jul 25 02:32:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Volume volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b (54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b): created successfully Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1d81c6-c266-49f9-a233-2656a277eb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:32:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Flow 'volume_create_manager' (b0e3130c-5935-4c27-bed6-a402f1f20e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:32:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-eb37ddb7-a541-4cce-a377-ae34752e8ae4 tempest-VolumesAdminNegativeTest-809992384 None] Created volume successfully. Jul 25 02:32:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Acquiring lock "cinder-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Lock "cinder-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Acquiring lock "cinder-quobyte-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Lock "cinder-quobyte-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b" acquired by "delete_volume" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[176358b3-0d1d-44f2-8b33-bf59f8778845]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:46 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b Jul 25 02:32:46 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:46 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b" returned: 0 in 0.681s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:46 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b Jul 25 02:32:46 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:47 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b" returned: 0 in 0.396s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Lock "cinder-quobyte-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b" released by "delete_volume" :: held 1.167s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Created reservations ['9865278c-7c8e-4498-a0c2-d1811815f8b0', 'e8235f39-9aa9-4d39-809a-5233a7b8b16f', '7cc296dd-1969-4bc6-a797-c4e7daeee471', '536105ca-0642-4802-9b83-41300bc2f3f9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:47 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:47 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:47 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.383s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:47 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Deleted volume successfully. Jul 25 02:32:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3eb4d255-3959-4e55-a93e-f61174877a95 tempest-VolumesAdminNegativeTest-809992384 None] Lock "cinder-54e1b44f-90b6-4db7-86fd-dd4eecaa6c5b-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:50 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:50 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:51 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.363s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:51 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-0e6cc341-8ead-4924-bc7f-05ed9c734f5b req-278a9a8d-4b66-4b79-bebf-ac78f91209b0 tempest-ServerActionsTestOtherA-686120853 None] Terminate volume connection completed successfully. Jul 25 02:32:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-0e6cc341-8ead-4924-bc7f-05ed9c734f5b req-278a9a8d-4b66-4b79-bebf-ac78f91209b0 tempest-ServerActionsTestOtherA-686120853 None] Deleting attachment 1ba400fe-b06f-4bbc-8db4-bc39313a3cf3. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:32:54 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=114,cinder:SELECT=121,cinder:INSERT=32,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:32:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-14cd2d41-2d74-4d1e-acd1-1c143bc89b1d tempest-GroupsV320Test-1337669525 None] Group tempest-GroupsV320Test-Group-90368229: creating Jul 25 02:32:54 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=115,cinder:SELECT=123,cinder:INSERT=20,cinder:DELETE=5 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:32:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-14cd2d41-2d74-4d1e-acd1-1c143bc89b1d tempest-GroupsV320Test-1337669525 None] Group tempest-GroupsV320Test-Group-90368229: created successfully Jul 25 02:32:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-14cd2d41-2d74-4d1e-acd1-1c143bc89b1d tempest-GroupsV320Test-1337669525 None] Create group completed successfully. Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Created reservations ['9c058357-8bb0-4449-b9ec-40b7f90dc325'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:56 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:56 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:56 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.313s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:56 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ecb4b46e-e687-4e16-b3ea-0582bb002105 tempest-GroupsV320Test-1337669525 None] Delete group completed successfully. Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "cinder-86a0e154-c69b-4366-9a05-f0b3351daa65-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Lock "cinder-86a0e154-c69b-4366-9a05-f0b3351daa65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "cinder-quobyte-86a0e154-c69b-4366-9a05-f0b3351daa65" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Lock "cinder-quobyte-86a0e154-c69b-4366-9a05-f0b3351daa65" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bab048-99f4-47fa-ae75-b469244a5aa8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:57 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 Jul 25 02:32:57 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:57 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65" returned: 0 in 0.462s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:57 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65 Jul 25 02:32:57 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:58 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-86a0e154-c69b-4366-9a05-f0b3351daa65" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Lock "cinder-quobyte-86a0e154-c69b-4366-9a05-f0b3351daa65" released by "delete_volume" :: held 0.780s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Created reservations ['b80d3118-f1cd-42c3-b207-4e79f8e39f36', 'fcd184ac-4e08-47ff-a685-473dd1f1a432', '2e05cf52-09b5-4b20-807a-ac4bc03d786b', '442b0e90-6b2c-4251-b594-375d512007f4'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:32:58 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:32:58 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:32:58 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.326s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:32:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Deleted volume successfully. Jul 25 02:32:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-328349b7-f566-4673-b877-e64da9c0b0a0 tempest-ServerActionsTestOtherA-686120853 None] Lock "cinder-86a0e154-c69b-4366-9a05-f0b3351daa65-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:33:08 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:33:08 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=10,cinder:SELECT=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:33:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-77b326e4-f277-4b06-b7d0-9c404bc162f3 req-295cafef-5c98-4b33-b76d-31dd2d1043a3 tempest-TaggedAttachmentsTest-1565778566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:33:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-77b326e4-f277-4b06-b7d0-9c404bc162f3 req-295cafef-5c98-4b33-b76d-31dd2d1043a3 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:33:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-77b326e4-f277-4b06-b7d0-9c404bc162f3 req-295cafef-5c98-4b33-b76d-31dd2d1043a3 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:33:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-77b326e4-f277-4b06-b7d0-9c404bc162f3 req-295cafef-5c98-4b33-b76d-31dd2d1043a3 tempest-TaggedAttachmentsTest-1565778566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d196c80-d352-40a4-b347-dab6ef7977ac', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:33:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-77b326e4-f277-4b06-b7d0-9c404bc162f3 req-295cafef-5c98-4b33-b76d-31dd2d1043a3 tempest-TaggedAttachmentsTest-1565778566 None] attachment_update completed successfully. Jul 25 02:33:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-79d9e9ad-f9f2-42d4-8eba-3e635d158583 req-c94827f5-7e39-423d-ab0f-3778c6834e70 tempest-TaggedAttachmentsTest-1565778566 None] Terminate volume connection completed successfully. Jul 25 02:33:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-79d9e9ad-f9f2-42d4-8eba-3e635d158583 req-c94827f5-7e39-423d-ab0f-3778c6834e70 tempest-TaggedAttachmentsTest-1565778566 None] Deleting attachment 3d196c80-d352-40a4-b347-dab6ef7977ac. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:33:23 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:33:27 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:33:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Acquiring lock "cinder-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:33:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Lock "cinder-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:33:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Acquiring lock "cinder-quobyte-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:33:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Lock "cinder-quobyte-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:33:38 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88b5fd1-3b57-4b4d-8dac-43d6358c017f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:33:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:33:38 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 Jul 25 02:33:38 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:33:39 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 25 02:33:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75" returned: 0 in 1.035s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:33:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:33:39 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75 Jul 25 02:33:39 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:33:39 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 25 02:33:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75" returned: 0 in 0.606s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:33:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Lock "cinder-quobyte-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75" released by "delete_volume" :: held 1.719s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Created reservations ['e0fa0564-97f8-4a4e-9f00-01b919ceacf6', '9113557d-46f5-47c3-9715-c0a54249b618', '00b55ea8-4448-454d-bf57-132f41d087a4', '7f5a8bd8-774a-4940-9a45-c2c7a0224aad'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:33:40 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:33:40 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:33:40 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.467s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:33:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Deleted volume successfully. Jul 25 02:33:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ae541ae7-4be5-45c1-aca6-0a4321244f26 tempest-TaggedAttachmentsTest-1565778566 None] Lock "cinder-20b3a0e4-75fc-4d64-b5f1-313f0a43ea75-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:33:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:33:50 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:33:50 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:33:51 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 25 02:33:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.946s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:33:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:33:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:33:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 8 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:33:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Flow 'volume_create_manager' (79eada51-8f6b-49d3-931f-72bd16f71d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af70f7d2-c1a1-4cb4-8474-f911e0a871cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af70f7d2-c1a1-4cb4-8474-f911e0a871cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2039356787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d372a25-f19d-4950-809d-0f2ecb611bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e03ad2c97d48249e57c3a724a7d4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:00Z,use_quota=True,user_id='7fc417bd948747789e4e0358744aeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732e24aa-5a2c-4575-b0fd-a2cb1288172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732e24aa-5a2c-4575-b0fd-a2cb1288172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cc3e36-05c1-4eb3-80d2-19f90c718e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cc3e36-05c1-4eb3-80d2-19f90c718e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d372a25-f19d-4950-809d-0f2ecb611bc9', 'volume_name': 'volume-6d372a25-f19d-4950-809d-0f2ecb611bc9', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ff67a9-209e-465f-ba26-2c91993821ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ff67a9-209e-465f-ba26-2c91993821ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe23ce6b-adac-4540-b1f8-feb591587be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Volume 6d372a25-f19d-4950-809d-0f2ecb611bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d372a25-f19d-4950-809d-0f2ecb611bc9', 'volume_size': 1} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2039356787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d372a25-f19d-4950-809d-0f2ecb611bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e03ad2c97d48249e57c3a724a7d4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:00Z,use_quota=True,user_id='7fc417bd948747789e4e0358744aeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Creating volume 6d372a25-f19d-4950-809d-0f2ecb611bc9 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:00 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:00 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 1073741824 Jul 25 02:34:00 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:01 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 1073741824" returned: 0 in 0.852s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:01 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 Jul 25 02:34:01 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:01 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9" returned: 0 in 0.549s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe23ce6b-adac-4540-b1f8-feb591587be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d372a25-f19d-4950-809d-0f2ecb611bc9', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8bd133-bd39-4c3c-bdcf-4260e42df3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Volume volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 (6d372a25-f19d-4950-809d-0f2ecb611bc9): created successfully Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8bd133-bd39-4c3c-bdcf-4260e42df3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Flow 'volume_create_manager' (79eada51-8f6b-49d3-931f-72bd16f71d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-11e222b3-56fe-4dc6-b5d5-e799fac2835a tempest-VolumeQuotasAdminTestJSON-1193647927 None] Created volume successfully. Jul 25 02:34:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "cinder-6d372a25-f19d-4950-809d-0f2ecb611bc9-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "cinder-6d372a25-f19d-4950-809d-0f2ecb611bc9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "cinder-quobyte-6d372a25-f19d-4950-809d-0f2ecb611bc9" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "cinder-quobyte-6d372a25-f19d-4950-809d-0f2ecb611bc9" acquired by "delete_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:02 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0da0554-48ce-4cf6-8b8f-759fd945ade3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:02 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 Jul 25 02:34:02 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Flow 'volume_create_manager' (bf8b8c57-8e6b-4ed1-be82-6447ebe43297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa12dc62-f6db-48dc-89d2-967131d8a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa12dc62-f6db-48dc-89d2-967131d8a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-89878649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21056089e84a4453974f7f450ea70d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:03Z,use_quota=True,user_id='22b68a80268e4c2dba7786bad31ddcd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8be3260-48c4-42b1-aeb7-c7e2b4f0107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8be3260-48c4-42b1-aeb7-c7e2b4f0107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6483372-effb-48ea-8007-ace1e0477820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6483372-effb-48ea-8007-ace1e0477820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8', 'volume_name': 'volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb78843b-c97c-4c56-ade0-4b1e267389b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb78843b-c97c-4c56-ade0-4b1e267389b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ea7c72-fcf3-4956-93fe-06369e6287d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Volume 4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8', 'volume_size': 1} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-89878649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21056089e84a4453974f7f450ea70d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:03Z,use_quota=True,user_id='22b68a80268e4c2dba7786bad31ddcd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Creating volume 4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:03 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:03 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 1073741824 Jul 25 02:34:03 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:03 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9" returned: 0 in 0.787s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:03 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9 Jul 25 02:34:03 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:04 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d372a25-f19d-4950-809d-0f2ecb611bc9" returned: 0 in 0.471s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "cinder-quobyte-6d372a25-f19d-4950-809d-0f2ecb611bc9" released by "delete_volume" :: held 1.355s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:04 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 1073741824" returned: 0 in 0.700s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Created reservations ['88cf3fc4-e69b-4c9f-bfb5-bd2cfe8b211b', 'c1f1aa53-dc7f-4480-89ac-650030a82610', 'c5a2e35d-3dbd-4e47-b713-ddfd608ebf28', 'bfa2c7d7-4cad-4e9a-8b90-b2e40741c583'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:04 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 Jul 25 02:34:04 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:04 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:04 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:04 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.458s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Deleted volume successfully. Jul 25 02:34:04 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4c9efb9-4803-4fde-9a74-b2b22eef9720 tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "cinder-6d372a25-f19d-4950-809d-0f2ecb611bc9-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8" returned: 0 in 0.682s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ea7c72-fcf3-4956-93fe-06369e6287d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2536a7cd-8754-4dc4-9b64-ba2cc39e9f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Volume volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 (4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8): created successfully Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2536a7cd-8754-4dc4-9b64-ba2cc39e9f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Flow 'volume_create_manager' (bf8b8c57-8e6b-4ed1-be82-6447ebe43297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4f92197f-ca94-4a39-acbd-7f90ba4385b1 tempest-ServerRescueNegativeTestJSON-1909895136 None] Created volume successfully. Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Flow 'volume_create_manager' (d8c4f5f1-c2f5-498f-80f8-2ac367c3f0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a61585-894b-4f8f-a853-ff0220c40926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a61585-894b-4f8f-a853-ff0220c40926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-399459319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cde3850-c064-4bfa-9e73-8294536df841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e03ad2c97d48249e57c3a724a7d4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:06Z,use_quota=True,user_id='7fc417bd948747789e4e0358744aeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486139a3-cee7-45c6-a77f-a5b537af8444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486139a3-cee7-45c6-a77f-a5b537af8444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47950c41-089b-4960-881e-fc7bc23cc3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47950c41-089b-4960-881e-fc7bc23cc3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cde3850-c064-4bfa-9e73-8294536df841', 'volume_name': 'volume-3cde3850-c064-4bfa-9e73-8294536df841', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b768b3d-0b79-42f7-83fb-aa0cb356c1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b768b3d-0b79-42f7-83fb-aa0cb356c1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4adbe4-28cc-4cdb-b897-697a006b3aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:06 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Volume 3cde3850-c064-4bfa-9e73-8294536df841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cde3850-c064-4bfa-9e73-8294536df841', 'volume_size': 1} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-399459319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cde3850-c064-4bfa-9e73-8294536df841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e03ad2c97d48249e57c3a724a7d4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:06Z,use_quota=True,user_id='7fc417bd948747789e4e0358744aeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Creating volume 3cde3850-c064-4bfa-9e73-8294536df841 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:06 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:06 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 1073741824 Jul 25 02:34:06 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:07 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 1073741824" returned: 0 in 0.956s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:07 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 Jul 25 02:34:07 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:07 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841" returned: 0 in 0.474s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4adbe4-28cc-4cdb-b897-697a006b3aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cde3850-c064-4bfa-9e73-8294536df841', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2203f949-b4fb-4add-b2a7-70a911f02c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:07 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Volume volume-3cde3850-c064-4bfa-9e73-8294536df841 (3cde3850-c064-4bfa-9e73-8294536df841): created successfully Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2203f949-b4fb-4add-b2a7-70a911f02c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Flow 'volume_create_manager' (d8c4f5f1-c2f5-498f-80f8-2ac367c3f0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-39038ab7-f155-4ad3-aef8-ab23147c97eb tempest-VolumeQuotasAdminTestJSON-1193647927 None] Created volume successfully. Jul 25 02:34:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4f3254bd-6612-41b4-96bd-7b6593ebe4ad tempest-VolumeQuotasAdminTestJSON-23534919 None] Transfer volume completed successfully. Jul 25 02:34:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Acquiring lock "cinder-3cde3850-c064-4bfa-9e73-8294536df841-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Lock "cinder-3cde3850-c064-4bfa-9e73-8294536df841-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Acquiring lock "cinder-quobyte-3cde3850-c064-4bfa-9e73-8294536df841" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Lock "cinder-quobyte-3cde3850-c064-4bfa-9e73-8294536df841" acquired by "delete_volume" :: waited 0.033s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c870c07-8cb2-42f5-a7c8-09eec094cc59]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:11 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 Jul 25 02:34:11 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:11 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841" returned: 0 in 0.818s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:11 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841 Jul 25 02:34:11 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:12 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3cde3850-c064-4bfa-9e73-8294536df841" returned: 0 in 0.454s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Lock "cinder-quobyte-3cde3850-c064-4bfa-9e73-8294536df841" released by "delete_volume" :: held 1.353s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Created reservations ['09800d2c-f513-494c-98b0-ed13396b7704', 'b994e15d-1894-4330-b5ed-70975c932a20', '0ea0ec43-35ed-45ce-8dca-d77af47019f9', '03dba31c-87a2-48bb-88c8-9c06a63ea4b4'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:12 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:12 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:13 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.428s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:13 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Deleted volume successfully. Jul 25 02:34:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3901fcca-fea3-42d5-9684-d2ceb13ca986 tempest-VolumeQuotasAdminTestJSON-1300907474 None] Lock "cinder-3cde3850-c064-4bfa-9e73-8294536df841-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Flow 'volume_create_manager' (685f9fc1-082f-41b7-a99d-d42eb38e4db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e30bebd-ae8c-466f-a794-be277eb95e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e30bebd-ae8c-466f-a794-be277eb95e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1769665644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6488b7-34ac-408f-b96c-0be158b55ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed8b47cdae24a4faf21a8f1e32e5578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:15Z,use_quota=True,user_id='d6551299b18540d7980b63d3bacbde7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8208ab5c-e7ab-4631-bc08-334331526746),volume_type_id=8208ab5c-e7ab-4631-bc08-334331526746)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d581b80-6de3-4718-bf78-e7119bcc55f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d581b80-6de3-4718-bf78-e7119bcc55f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b0099b-e03e-4a5b-aa4b-545470fb0b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b0099b-e03e-4a5b-aa4b-545470fb0b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6488b7-34ac-408f-b96c-0be158b55ce7', 'volume_name': 'volume-ed6488b7-34ac-408f-b96c-0be158b55ce7', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4d9ecf-c3b7-448a-b2fa-a5e23ae70c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4d9ecf-c3b7-448a-b2fa-a5e23ae70c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a7487-1c22-4b25-8666-2e27e8786026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:15 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Volume ed6488b7-34ac-408f-b96c-0be158b55ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6488b7-34ac-408f-b96c-0be158b55ce7', 'volume_size': 1} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1769665644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6488b7-34ac-408f-b96c-0be158b55ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed8b47cdae24a4faf21a8f1e32e5578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:15Z,use_quota=True,user_id='d6551299b18540d7980b63d3bacbde7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8208ab5c-e7ab-4631-bc08-334331526746),volume_type_id=8208ab5c-e7ab-4631-bc08-334331526746)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Creating volume ed6488b7-34ac-408f-b96c-0be158b55ce7 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:15 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:15 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 1073741824 Jul 25 02:34:15 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:16 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 1073741824" returned: 0 in 0.513s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:16 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 Jul 25 02:34:16 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:16 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a7487-1c22-4b25-8666-2e27e8786026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6488b7-34ac-408f-b96c-0be158b55ce7', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a0540d-b397-4adb-9262-12d859133780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:16 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Volume volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 (ed6488b7-34ac-408f-b96c-0be158b55ce7): created successfully Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a0540d-b397-4adb-9262-12d859133780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Flow 'volume_create_manager' (685f9fc1-082f-41b7-a99d-d42eb38e4db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-80026715-b85d-4a83-941b-276da5735089 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Created volume successfully. Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Acquiring lock "cinder-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "cinder-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Acquiring lock "cinder-quobyte-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "cinder-quobyte-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:18 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:18 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[75028f51-8517-4dcc-90f5-cf01fda7bcc6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:18 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 Jul 25 02:34:18 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:18 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.327s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-72fa9404-a34c-4470-8e06-2930bddc7107 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Retype volume completed successfully. Jul 25 02:34:18 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8" returned: 0 in 0.458s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:18 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8 Jul 25 02:34:18 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:19 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "cinder-quobyte-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8" released by "delete_volume" :: held 0.865s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Created reservations ['89dc7e9e-dc52-4624-8ef4-5180f6e00803', 'e930336d-0a79-4850-ba81-87824cc70540', '8092e966-ecf8-4cce-aaf8-1f7ea5d31cfb', '124688ef-0d9b-4292-b129-927059bc665a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:19 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:19 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:19 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.427s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Deleted volume successfully. Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Acquiring lock "cinder-ed6488b7-34ac-408f-b96c-0be158b55ce7-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7806dbee-6f80-4284-8c03-e0e864cb1634 tempest-ServerRescueNegativeTestJSON-1909895136 None] Lock "cinder-4abd2ee6-c29b-4c82-bac6-37c6ee8e41a8-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "cinder-ed6488b7-34ac-408f-b96c-0be158b55ce7-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Acquiring lock "cinder-quobyte-ed6488b7-34ac-408f-b96c-0be158b55ce7" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "cinder-quobyte-ed6488b7-34ac-408f-b96c-0be158b55ce7" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:20 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef9724-e856-44ed-8213-1b5d0aa136f5]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:20 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 Jul 25 02:34:20 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:20 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7" returned: 0 in 0.681s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:20 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7 Jul 25 02:34:20 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:21 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ed6488b7-34ac-408f-b96c-0be158b55ce7" returned: 0 in 0.678s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "cinder-quobyte-ed6488b7-34ac-408f-b96c-0be158b55ce7" released by "delete_volume" :: held 1.485s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:21 devstack cinder-volume[88279]: WARNING cinder.quota [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:34:21 devstack cinder-volume[88279]: WARNING cinder.quota [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Created reservations ['3b461117-c391-421b-b8cc-43cebe712494', '2e80a7b4-52e5-4f8a-ba29-e770bf8c8766', '387c3bac-cd7f-4ca6-9023-eda7ce444788', 'dbea2ecc-ee8b-47c0-83a0-abf68c35abf6'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:21 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:21 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:22 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.784s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:22 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Deleted volume successfully. Jul 25 02:34:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff16f477-9f5a-4bd7-a555-e6ecf29ceab6 tempest-VolumeRetypeWithoutMigrationTest-1058648998 None] Lock "cinder-ed6488b7-34ac-408f-b96c-0be158b55ce7-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Flow 'volume_create_manager' (dfd6929a-710c-4307-b6ff-87de3c804e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6386864-c5b6-4cec-b6c4-5bdda685c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6386864-c5b6-4cec-b6c4-5bdda685c560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1377105576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4762a9-d0b7-40e5-9fa1-38d66990d019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8af6cb84c7459f9ed4826e94eba7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:25Z,use_quota=True,user_id='5cf4a10c45d94c3698938cb64381aa67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820bd7ed-c0b8-4998-b98a-ab33ad582b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820bd7ed-c0b8-4998-b98a-ab33ad582b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e72988-4383-40c2-8c4f-f3714d5705b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e72988-4383-40c2-8c4f-f3714d5705b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f4762a9-d0b7-40e5-9fa1-38d66990d019', 'volume_name': 'volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e968ace-7ba6-443a-aad6-c748ef091925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e968ace-7ba6-443a-aad6-c748ef091925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9288bd30-b147-45f8-85cd-cd5727bdadbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:24 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Volume 5f4762a9-d0b7-40e5-9fa1-38d66990d019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019', 'volume_size': 1} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1377105576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4762a9-d0b7-40e5-9fa1-38d66990d019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8af6cb84c7459f9ed4826e94eba7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:25Z,use_quota=True,user_id='5cf4a10c45d94c3698938cb64381aa67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Creating volume 5f4762a9-d0b7-40e5-9fa1-38d66990d019 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:25 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:25 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 1073741824 Jul 25 02:34:25 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:25 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 1073741824" returned: 0 in 0.836s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:25 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 Jul 25 02:34:25 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:26 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019" returned: 0 in 0.435s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9288bd30-b147-45f8-85cd-cd5727bdadbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16c2976-6fec-4b88-9da1-8af38ef972bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:26 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Volume volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 (5f4762a9-d0b7-40e5-9fa1-38d66990d019): created successfully Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16c2976-6fec-4b88-9da1-8af38ef972bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Flow 'volume_create_manager' (dfd6929a-710c-4307-b6ff-87de3c804e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-59eb9787-2eb2-4d2e-a2e3-1ebaf4085eb3 tempest-AttachVolumeShelveTestJSON-1324956417 None] Created volume successfully. Jul 25 02:34:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Flow 'volume_create_manager' (7a4c22c5-f3d0-48ce-a1be-4a3bfd2293e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d0d31b-5c4b-4835-a003-8577ad08ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d0d31b-5c4b-4835-a003-8577ad08ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-508174167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86af9c0964274068baf767aecbcc0a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:32Z,use_quota=True,user_id='ce166fa6b5bc4723a769d5649d478318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25561be-39c7-4316-a675-f4f917869e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25561be-39c7-4316-a675-f4f917869e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de856e45-932e-4180-b3ce-8e418517c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de856e45-932e-4180-b3ce-8e418517c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1', 'volume_name': 'volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da94156-b7ff-46c1-9faa-e7d36f3fc5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da94156-b7ff-46c1-9faa-e7d36f3fc5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130dcaea-51d8-4869-b253-0f2443fd64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Volume e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1', 'volume_size': 1} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-508174167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86af9c0964274068baf767aecbcc0a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:32Z,use_quota=True,user_id='ce166fa6b5bc4723a769d5649d478318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Creating volume e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:32 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:32 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 1073741824 Jul 25 02:34:32 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:32 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 1073741824" returned: 0 in 0.666s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:32 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 Jul 25 02:34:32 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:33 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1" returned: 0 in 0.313s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130dcaea-51d8-4869-b253-0f2443fd64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054533e0-9738-4b9e-8426-b0677eb59946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:33 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Volume volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 (e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1): created successfully Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054533e0-9738-4b9e-8426-b0677eb59946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Flow 'volume_create_manager' (7a4c22c5-f3d0-48ce-a1be-4a3bfd2293e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-39b3b17c-b492-4e02-9aa4-39db65d8f2f7 tempest-VolumesServicesTestJSON-1432832148 None] Created volume successfully. Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Acquiring lock "cinder-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Lock "cinder-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Acquiring lock "cinder-quobyte-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Lock "cinder-quobyte-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f69910-eca4-4da3-873d-58a281a98468]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:34 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 Jul 25 02:34:34 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:34 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1" returned: 0 in 0.415s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:34 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1 Jul 25 02:34:34 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:35 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1" returned: 0 in 0.327s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Lock "cinder-quobyte-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1" released by "delete_volume" :: held 0.806s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Created reservations ['84de8133-8a11-4a79-bbc9-c2e0e1b7c2c1', '92812bff-f395-425e-87b9-1e22fced8b9c', 'dddc7200-0f70-45e9-9a8d-b1457ec200e1', '53018e25-17db-404a-b61d-84701b3d7295'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:35 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:35 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:35 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.375s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:35 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Deleted volume successfully. Jul 25 02:34:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb5f46f0-ce7e-48e9-9080-409209819fac tempest-VolumesServicesTestJSON-1432832148 None] Lock "cinder-e3d16ed5-1e93-4fcf-8e13-f8ae351a7dc1-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-1c2393a9-988c-4375-942e-79b7f3786c3a req-34e24636-0f76-4c25-b4d4-9a5128a9dd34 tempest-AttachVolumeShelveTestJSON-1324956417 None] No connector for attachment e871e1cf-f5c8-4d8a-9251-266cf6b5feb2; skipping storage backend terminate_connection call. {{(pid=88279) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 25 02:34:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-1c2393a9-988c-4375-942e-79b7f3786c3a req-34e24636-0f76-4c25-b4d4-9a5128a9dd34 tempest-AttachVolumeShelveTestJSON-1324956417 None] Deleting attachment e871e1cf-f5c8-4d8a-9251-266cf6b5feb2. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Flow 'volume_create_manager' (f6fe8624-7341-4d78-a608-264f23ed3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18857ab-c845-49fe-95b4-6b688d41aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18857ab-c845-49fe-95b4-6b688d41aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-52370819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e6074d-977e-4b88-aebe-8f5c5c00d502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f0f1b737b74b08bd776c616f84153c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:43Z,use_quota=True,user_id='fdbc40b9a1e740b08b3d229f59027e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c6eff0-0f65-4488-bd73-4884b8b56c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c6eff0-0f65-4488-bd73-4884b8b56c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab05f619-8b17-4e93-95dd-50c6415511c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab05f619-8b17-4e93-95dd-50c6415511c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e6074d-977e-4b88-aebe-8f5c5c00d502', 'volume_name': 'volume-06e6074d-977e-4b88-aebe-8f5c5c00d502', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef16aac-d9b7-4b3b-94da-2e1468eb639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef16aac-d9b7-4b3b-94da-2e1468eb639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ead51b-1e8d-446c-a616-3c5a0bd56c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:43 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Volume 06e6074d-977e-4b88-aebe-8f5c5c00d502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e6074d-977e-4b88-aebe-8f5c5c00d502', 'volume_size': 1} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-52370819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e6074d-977e-4b88-aebe-8f5c5c00d502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f0f1b737b74b08bd776c616f84153c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:43Z,use_quota=True,user_id='fdbc40b9a1e740b08b3d229f59027e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Creating volume 06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:43 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:43 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 1073741824 Jul 25 02:34:43 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:44 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 1073741824" returned: 0 in 0.595s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:44 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 Jul 25 02:34:44 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:44 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502" returned: 0 in 0.455s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ead51b-1e8d-446c-a616-3c5a0bd56c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e6074d-977e-4b88-aebe-8f5c5c00d502', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bae4a85-3447-4b20-a542-23d1161832e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Volume volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 (06e6074d-977e-4b88-aebe-8f5c5c00d502): created successfully Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bae4a85-3447-4b20-a542-23d1161832e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Flow 'volume_create_manager' (f6fe8624-7341-4d78-a608-264f23ed3782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-578db2f5-8f9e-4645-bcda-6cac70f5dcf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Created volume successfully. Jul 25 02:34:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Creating offline snapshot 35339678-0492-423e-a8e0-d75be3c719cd of volume 06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:34:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca4add1-a743-42e8-92ab-b8003509d81a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:46 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 Jul 25 02:34:46 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:46 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502" returned: 0 in 0.441s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:46 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd 1G Jul 25 02:34:46 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:46 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd 1G" returned: 0 in 0.503s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:47 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd Jul 25 02:34:47 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:47 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd" returned: 0 in 0.349s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:47 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd is being set with open permissions: ugo+rw Jul 25 02:34:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:47 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd Jul 25 02:34:47 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:47 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:47 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info Jul 25 02:34:47 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:47 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:47 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info is being set with open permissions: ugo+rw Jul 25 02:34:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:47 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info Jul 25 02:34:47 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:48 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.info" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-77e944d4-1fb5-45b7-a12e-5fcf2a9599e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Create snapshot completed successfully Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "cinder-35339678-0492-423e-a8e0-d75be3c719cd-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-35339678-0492-423e-a8e0-d75be3c719cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "cinder-quobyte-06e6074d-977e-4b88-aebe-8f5c5c00d502" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-quobyte-06e6074d-977e-4b88-aebe-8f5c5c00d502" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "cinder-quobyte-35339678-0492-423e-a8e0-d75be3c719cd" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-quobyte-35339678-0492-423e-a8e0-d75be3c719cd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Deleting offline snapshot 35339678-0492-423e-a8e0-d75be3c719cd of volume 06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] snapshot_file for this snap is: volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1db838-c955-48c5-b4af-e96fd9825c90]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:50 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd Jul 25 02:34:50 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:50 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd" returned: 0 in 0.576s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06e6074d-977e-4b88-aebe-8f5c5c00d502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c26160-e16f-4feb-8125-441fbe29d704]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:50 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 Jul 25 02:34:50 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:50 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:50 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:51 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.472s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 8 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502" returned: 0 in 0.777s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:51 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:51 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd Jul 25 02:34:51 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:51 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd" returned: 0 in 0.499s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:51 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd Jul 25 02:34:51 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:52 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502.35339678-0492-423e-a8e0-d75be3c719cd" returned: 0 in 0.304s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=75,cinder:SELECT=51,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=54,cinder:UPDATE=60,cinder:DELETE=9,cinder:INSERT=13 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-quobyte-35339678-0492-423e-a8e0-d75be3c719cd" released by "_delete_snapshot" :: held 2.329s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-quobyte-06e6074d-977e-4b88-aebe-8f5c5c00d502" released by "delete_snapshot" :: held 2.368s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:52 devstack cinder-volume[88279]: WARNING cinder.quota [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Created reservations ['4f8808b6-191a-4b58-9001-ee6a369795a9', '3d0e770a-f7c0-4d47-8f61-cbf73b3c1b4f', '89770893-53e8-4944-988b-9f82b7ed8951', '497ccfc8-544c-40fe-b07c-e3b2194e4fb0'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Delete snapshot completed successfully. Jul 25 02:34:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b1da3e20-3e43-413c-9a7a-be16c7879490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-35339678-0492-423e-a8e0-d75be3c719cd-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "cinder-06e6074d-977e-4b88-aebe-8f5c5c00d502-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-06e6074d-977e-4b88-aebe-8f5c5c00d502-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "cinder-quobyte-06e6074d-977e-4b88-aebe-8f5c5c00d502" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-quobyte-06e6074d-977e-4b88-aebe-8f5c5c00d502" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb0d3a-14c8-414d-88b2-0711278199f6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:53 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 Jul 25 02:34:53 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Flow 'volume_create_manager' (3196d661-eda0-4b72-8c62-a07f1b301f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242956c8-5b72-4f3a-b7cb-683f30df3c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242956c8-5b72-4f3a-b7cb-683f30df3c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-271840019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b4f325-31e4-4a45-8fa1-e2ece2a662a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a1a38fb7f4e888de0b112cae26824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:54Z,use_quota=True,user_id='f0ff8fccb7c746f28819cd8087806b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf79b6c-2e5d-456b-aa04-1a19ac48756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf79b6c-2e5d-456b-aa04-1a19ac48756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0072b4-44e4-4286-be0e-d4118dcd6fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0072b4-44e4-4286-be0e-d4118dcd6fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b4f325-31e4-4a45-8fa1-e2ece2a662a9', 'volume_name': 'volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34003b-73c3-49f6-9e3f-4eb68226d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34003b-73c3-49f6-9e3f-4eb68226d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666c3f96-0c48-4f2c-8f89-c252bab7ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:53 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Volume 52b4f325-31e4-4a45-8fa1-e2ece2a662a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9', 'volume_size': 1} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-271840019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b4f325-31e4-4a45-8fa1-e2ece2a662a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a1a38fb7f4e888de0b112cae26824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:34:54Z,use_quota=True,user_id='f0ff8fccb7c746f28819cd8087806b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Creating volume 52b4f325-31e4-4a45-8fa1-e2ece2a662a9 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:34:53 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:53 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502" returned: 0 in 0.469s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:53 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 1073741824 Jul 25 02:34:53 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:53 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502 Jul 25 02:34:53 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:54 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-06e6074d-977e-4b88-aebe-8f5c5c00d502" returned: 0 in 0.277s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-quobyte-06e6074d-977e-4b88-aebe-8f5c5c00d502" released by "delete_volume" :: held 0.841s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Created reservations ['35613d20-452e-409b-9fd1-c2b6490809d8', '51f0e580-5948-41b0-9a0a-bd3a3143827c', '45199a7a-2e32-4383-b2a4-9db416a90036', '20a8aabd-4f8e-45b1-87ba-c36bf531c258'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:54 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:34:54 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:54 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 1073741824" returned: 0 in 0.661s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:54 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 Jul 25 02:34:54 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:54 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.333s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:34:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Deleted volume successfully. Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f97d25f5-f7cb-49ea-9e0f-69a345c3d8aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1782112289 None] Lock "cinder-06e6074d-977e-4b88-aebe-8f5c5c00d502-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:54 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666c3f96-0c48-4f2c-8f89-c252bab7ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f071e-49f8-40db-8443-0951721853ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:34:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Volume volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 (52b4f325-31e4-4a45-8fa1-e2ece2a662a9): created successfully Jul 25 02:34:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f071e-49f8-40db-8443-0951721853ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:34:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Flow 'volume_create_manager' (3196d661-eda0-4b72-8c62-a07f1b301f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:34:55 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a01b02c4-3697-485d-9ebc-cb6782e43e38 tempest-VolumesTransfersTest-2126550157 None] Created volume successfully. Jul 25 02:34:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-39ee9112-6992-4b57-b33d-edc958a8afb3 tempest-VolumesTransfersTest-252777023 None] Transfer volume completed successfully. Jul 25 02:34:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Acquiring lock "cinder-52b4f325-31e4-4a45-8fa1-e2ece2a662a9-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Lock "cinder-52b4f325-31e4-4a45-8fa1-e2ece2a662a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Acquiring lock "cinder-quobyte-52b4f325-31e4-4a45-8fa1-e2ece2a662a9" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:34:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Lock "cinder-quobyte-52b4f325-31e4-4a45-8fa1-e2ece2a662a9" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:34:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c585ea8-fcff-45fb-bbaf-9c88e43f5476]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:34:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:58 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 Jul 25 02:34:58 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:59 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9" returned: 0 in 0.898s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:34:59 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9 Jul 25 02:34:59 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:34:59 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52b4f325-31e4-4a45-8fa1-e2ece2a662a9" returned: 0 in 0.479s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Lock "cinder-quobyte-52b4f325-31e4-4a45-8fa1-e2ece2a662a9" released by "delete_volume" :: held 1.494s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Created reservations ['c0b4a8b9-b42b-456d-bc3a-55aff797c3b9', '3770dd66-3dd9-4448-8cb9-714ca22f00c3', '47b67935-97af-4439-b1cf-07440796d6be', 'afbe05b6-1b2f-4940-8077-9017ac82f2b9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:34:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:00 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:00 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:00 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.829s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:00 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Deleted volume successfully. Jul 25 02:35:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5042238e-18b9-4cdd-9b62-cf5fa989272b tempest-VolumesTransfersTest-333758775 None] Lock "cinder-52b4f325-31e4-4a45-8fa1-e2ece2a662a9-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:01 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Flow 'volume_create_manager' (356e6840-b2de-4f38-8217-c640ecc54e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544d4054-e38d-470d-9391-a5edcb48763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544d4054-e38d-470d-9391-a5edcb48763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-974269295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c02d60-0bad-40d9-8f93-ead9e6defd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a1a38fb7f4e888de0b112cae26824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:02Z,use_quota=True,user_id='f0ff8fccb7c746f28819cd8087806b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75942ff8-e9f0-4c8b-a9ce-445ab79a7268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75942ff8-e9f0-4c8b-a9ce-445ab79a7268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47924aa6-4dd6-4d8d-b1df-159375035e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47924aa6-4dd6-4d8d-b1df-159375035e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c02d60-0bad-40d9-8f93-ead9e6defd49', 'volume_name': 'volume-73c02d60-0bad-40d9-8f93-ead9e6defd49', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7a4c2a-ffb5-4cdd-b8a7-e0ba79f69d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7a4c2a-ffb5-4cdd-b8a7-e0ba79f69d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f995f7b-1afb-40e6-99a1-a2a4aac2337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Volume 73c02d60-0bad-40d9-8f93-ead9e6defd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c02d60-0bad-40d9-8f93-ead9e6defd49', 'volume_size': 1} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-974269295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c02d60-0bad-40d9-8f93-ead9e6defd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a1a38fb7f4e888de0b112cae26824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:02Z,use_quota=True,user_id='f0ff8fccb7c746f28819cd8087806b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Creating volume 73c02d60-0bad-40d9-8f93-ead9e6defd49 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:02 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:02 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 1073741824 Jul 25 02:35:02 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:02 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 1073741824" returned: 0 in 0.705s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:02 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 Jul 25 02:35:02 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:03 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49" returned: 0 in 0.297s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f995f7b-1afb-40e6-99a1-a2a4aac2337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c02d60-0bad-40d9-8f93-ead9e6defd49', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543b1458-1fec-4d17-88f7-aea7bddaafe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Volume volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 (73c02d60-0bad-40d9-8f93-ead9e6defd49): created successfully Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543b1458-1fec-4d17-88f7-aea7bddaafe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Flow 'volume_create_manager' (356e6840-b2de-4f38-8217-c640ecc54e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-41c779a0-6720-45b9-97a1-e05d25b36bb7 tempest-VolumesTransfersTest-2126550157 None] Created volume successfully. Jul 25 02:35:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Acquiring lock "cinder-73c02d60-0bad-40d9-8f93-ead9e6defd49-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Lock "cinder-73c02d60-0bad-40d9-8f93-ead9e6defd49-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Acquiring lock "cinder-quobyte-73c02d60-0bad-40d9-8f93-ead9e6defd49" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Lock "cinder-quobyte-73c02d60-0bad-40d9-8f93-ead9e6defd49" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:04 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40875ea-0661-4405-ae17-18d0581177e8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:04 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 Jul 25 02:35:04 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:05 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49" returned: 0 in 0.707s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:05 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49 Jul 25 02:35:05 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:05 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-73c02d60-0bad-40d9-8f93-ead9e6defd49" returned: 0 in 0.400s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Lock "cinder-quobyte-73c02d60-0bad-40d9-8f93-ead9e6defd49" released by "delete_volume" :: held 1.182s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Created reservations ['beedd80a-6619-482f-b9fc-3e68826a97b1', '9b95b4c4-202b-4103-a963-67b6d444e6bf', '798e6530-6474-430f-a663-8ecdcdfdd2b3', 'df693baf-724d-441e-8236-238fd074f63b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:06 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:06 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:06 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.309s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:06 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Deleted volume successfully. Jul 25 02:35:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dbcb5dcb-6956-406c-99a0-9b8ca6fb5bfd tempest-VolumesTransfersTest-333758775 None] Lock "cinder-73c02d60-0bad-40d9-8f93-ead9e6defd49-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Flow 'volume_create_manager' (cacb5e41-b341-4816-8c47-da6c5c796b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6f59c1-5632-4cd1-94c0-8ba33258e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6f59c1-5632-4cd1-94c0-8ba33258e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-453802857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d454e3-076b-408b-905b-17f9e78bcb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddc43076f64852be357860f4d9944d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:07Z,use_quota=True,user_id='15036b5508f44ec1a57040218dcf2acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b674b545-065a-405c-8090-76c9512b459c),volume_type_id=b674b545-065a-405c-8090-76c9512b459c)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf5bff3-e416-4b57-b6c9-04a7fa0bb281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf5bff3-e416-4b57-b6c9-04a7fa0bb281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186b6a04-a04b-427c-b070-4183c63ef1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186b6a04-a04b-427c-b070-4183c63ef1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d454e3-076b-408b-905b-17f9e78bcb3b', 'volume_name': 'volume-16d454e3-076b-408b-905b-17f9e78bcb3b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470da839-68b7-424e-a6fc-f591065cb4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470da839-68b7-424e-a6fc-f591065cb4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32adef8-c9d6-446d-89a3-04ff4c17822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:07 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Volume 16d454e3-076b-408b-905b-17f9e78bcb3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d454e3-076b-408b-905b-17f9e78bcb3b', 'volume_size': 1} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-453802857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d454e3-076b-408b-905b-17f9e78bcb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddc43076f64852be357860f4d9944d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:07Z,use_quota=True,user_id='15036b5508f44ec1a57040218dcf2acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b674b545-065a-405c-8090-76c9512b459c),volume_type_id=b674b545-065a-405c-8090-76c9512b459c)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Creating volume 16d454e3-076b-408b-905b-17f9e78bcb3b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:07 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:07 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b 1073741824 Jul 25 02:35:07 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:08 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b 1073741824" returned: 0 in 0.930s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:08 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b Jul 25 02:35:08 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:08 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b" returned: 0 in 0.465s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32adef8-c9d6-446d-89a3-04ff4c17822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d454e3-076b-408b-905b-17f9e78bcb3b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35996704-f7d3-47e9-8c48-8f5a0eb8b0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:08 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Volume volume-16d454e3-076b-408b-905b-17f9e78bcb3b (16d454e3-076b-408b-905b-17f9e78bcb3b): created successfully Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35996704-f7d3-47e9-8c48-8f5a0eb8b0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Flow 'volume_create_manager' (cacb5e41-b341-4816-8c47-da6c5c796b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1a0d9e90-5e11-406f-ba67-114569997bad tempest-VolumeTypesAccessTest-116090267 None] Created volume successfully. Jul 25 02:35:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Acquiring lock "cinder-16d454e3-076b-408b-905b-17f9e78bcb3b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Lock "cinder-16d454e3-076b-408b-905b-17f9e78bcb3b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Acquiring lock "cinder-quobyte-16d454e3-076b-408b-905b-17f9e78bcb3b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Lock "cinder-quobyte-16d454e3-076b-408b-905b-17f9e78bcb3b" acquired by "delete_volume" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d513c30-b989-420b-8499-fdcc2675caf9]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:10 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b Jul 25 02:35:10 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:10 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b" returned: 0 in 0.572s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:10 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b Jul 25 02:35:10 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:10 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-16d454e3-076b-408b-905b-17f9e78bcb3b" returned: 0 in 0.407s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Lock "cinder-quobyte-16d454e3-076b-408b-905b-17f9e78bcb3b" released by "delete_volume" :: held 1.110s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:11 devstack cinder-volume[88279]: WARNING cinder.quota [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-41715875 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-41715875, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:35:11 devstack cinder-volume[88279]: WARNING cinder.quota [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-41715875 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-41715875, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Created reservations ['cb44c7c4-c8a7-454b-ad93-bc6bf32a8978', 'cb7afe61-f952-4963-88fa-b53d5a09ef29', 'bbea2b37-bd24-48ca-b33e-2f0e750275a7', '9074cbb9-8d56-4347-aca9-1fdaad80b8cc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:11 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:11 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:11 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.438s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Deleted volume successfully. Jul 25 02:35:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d7e39bc-9b58-46df-9ab5-77654530e28d tempest-VolumeTypesAccessTest-116090267 None] Lock "cinder-16d454e3-076b-408b-905b-17f9e78bcb3b-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Flow 'volume_create_manager' (de227cf2-2bc2-43d8-a66e-ae41ce296c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa196e3c-3595-41ea-9942-65c926638188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa196e3c-3595-41ea-9942-65c926638188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-685389517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7ee643-3229-4ec4-909b-cd57d1bee571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01c3ad0be0a46999d819df5fd6b699d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:21Z,use_quota=True,user_id='f0c643a8586b4a25a5780d182949fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17a55b8-4b35-485e-aebd-85cf03f1a248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17a55b8-4b35-485e-aebd-85cf03f1a248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f334b7-0390-42dc-a738-5e547cc02e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f334b7-0390-42dc-a738-5e547cc02e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7ee643-3229-4ec4-909b-cd57d1bee571', 'volume_name': 'volume-ca7ee643-3229-4ec4-909b-cd57d1bee571', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e070a45-b1dc-4991-99c9-e042241961e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e070a45-b1dc-4991-99c9-e042241961e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2edd50d-b413-43b5-b2ca-0d46cf9713b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Volume ca7ee643-3229-4ec4-909b-cd57d1bee571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7ee643-3229-4ec4-909b-cd57d1bee571', 'volume_size': 1} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-685389517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7ee643-3229-4ec4-909b-cd57d1bee571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01c3ad0be0a46999d819df5fd6b699d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:21Z,use_quota=True,user_id='f0c643a8586b4a25a5780d182949fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Creating volume ca7ee643-3229-4ec4-909b-cd57d1bee571 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:21 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 1073741824 Jul 25 02:35:21 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:21 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=33,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=4 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:35:22 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 1073741824" returned: 0 in 0.659s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:22 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 Jul 25 02:35:22 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:22 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2edd50d-b413-43b5-b2ca-0d46cf9713b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7ee643-3229-4ec4-909b-cd57d1bee571', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b44779-db6e-4163-87a0-d7d6c082a6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Volume volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 (ca7ee643-3229-4ec4-909b-cd57d1bee571): created successfully Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b44779-db6e-4163-87a0-d7d6c082a6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Flow 'volume_create_manager' (de227cf2-2bc2-43d8-a66e-ae41ce296c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a2c80137-e101-4fb3-a868-892a9a01d7b0 tempest-VolumesTransfersV357Test-1452688615 None] Created volume successfully. Jul 25 02:35:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9301f307-6e21-4333-803f-54a1ebde82e0 tempest-VolumesTransfersV357Test-176017250 None] Transfer volume completed successfully. Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Flow 'volume_create_manager' (e02db314-0f39-4d5e-aa8b-5ec78ad94e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9e526d-5bc3-4015-82a5-327168e9a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Acquiring lock "cinder-ca7ee643-3229-4ec4-909b-cd57d1bee571-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9e526d-5bc3-4015-82a5-327168e9a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1519076081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d386adad-3ebf-43d1-8ff6-3a5be4f03ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8422f994bcf4e95aa0ecf7d8a5c1297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:25Z,use_quota=True,user_id='1508ab50a8674576bf86a352f0796b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2bd5f9-8319-419c-ac08-b393d09a045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2bd5f9-8319-419c-ac08-b393d09a045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108d6f94-aa95-4289-84f6-d84a85671d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108d6f94-aa95-4289-84f6-d84a85671d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd386adad-3ebf-43d1-8ff6-3a5be4f03ec0', 'volume_name': 'volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2e41a-1615-4f6f-89ea-e8941cceff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2e41a-1615-4f6f-89ea-e8941cceff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe79f85d-40cd-4d64-8289-35e1defe8051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:24 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Volume d386adad-3ebf-43d1-8ff6-3a5be4f03ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0', 'volume_size': 1} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1519076081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d386adad-3ebf-43d1-8ff6-3a5be4f03ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8422f994bcf4e95aa0ecf7d8a5c1297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:25Z,use_quota=True,user_id='1508ab50a8674576bf86a352f0796b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Creating volume d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:24 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-ca7ee643-3229-4ec4-909b-cd57d1bee571-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:24 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 1073741824 Jul 25 02:35:24 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Acquiring lock "cinder-quobyte-ca7ee643-3229-4ec4-909b-cd57d1bee571" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-quobyte-ca7ee643-3229-4ec4-909b-cd57d1bee571" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b3d66-da6a-475f-9b6b-c615ca6bcd99]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:24 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 Jul 25 02:35:24 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:25 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571" returned: 0 in 0.433s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:25 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 1073741824" returned: 0 in 0.564s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:25 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571 Jul 25 02:35:25 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:25 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 Jul 25 02:35:25 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:25 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ca7ee643-3229-4ec4-909b-cd57d1bee571" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-quobyte-ca7ee643-3229-4ec4-909b-cd57d1bee571" released by "delete_volume" :: held 0.869s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:25 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0" returned: 0 in 0.375s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe79f85d-40cd-4d64-8289-35e1defe8051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bed375-ce21-4093-807f-865b973cc5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Created reservations ['4e76a23f-3bb6-46f2-a964-581ee1e96652', '5c44f619-3e83-474a-a6a0-c1a009abb18c', '293639cb-ec0e-4237-b4b5-54356b8c3cfd', 'fe28e772-68fa-4b9f-a922-ed65d5ef07e5'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:25 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Volume volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 (d386adad-3ebf-43d1-8ff6-3a5be4f03ec0): created successfully Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bed375-ce21-4093-807f-865b973cc5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Flow 'volume_create_manager' (e02db314-0f39-4d5e-aa8b-5ec78ad94e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5f6c9516-fe5e-4a26-96f3-806d06eddb50 tempest-ServersNegativeTestJSON-1234057021 None] Created volume successfully. Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:25 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:25 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:26 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:26 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Deleted volume successfully. Jul 25 02:35:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-28ae81de-00b7-416c-b8d4-88906dd207ad tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-ca7ee643-3229-4ec4-909b-cd57d1bee571-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Flow 'volume_create_manager' (92423061-be9f-426e-95ad-ba0f6508f406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f061ecf5-00d4-47c8-9b76-6a624873c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f061ecf5-00d4-47c8-9b76-6a624873c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-335367888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595ea179-fc93-4405-9361-bbe3a396db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01c3ad0be0a46999d819df5fd6b699d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:28Z,use_quota=True,user_id='f0c643a8586b4a25a5780d182949fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4273c6f-b294-4cab-a6e0-09d52a9e4972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4273c6f-b294-4cab-a6e0-09d52a9e4972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a227322-d704-442e-9575-7fb088116363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a227322-d704-442e-9575-7fb088116363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595ea179-fc93-4405-9361-bbe3a396db0e', 'volume_name': 'volume-595ea179-fc93-4405-9361-bbe3a396db0e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5f9ad1-9ffc-4042-8dc3-bff18d666a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5f9ad1-9ffc-4042-8dc3-bff18d666a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaa4747-3854-4a93-8443-59973e878744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Volume 595ea179-fc93-4405-9361-bbe3a396db0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595ea179-fc93-4405-9361-bbe3a396db0e', 'volume_size': 1} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-335367888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595ea179-fc93-4405-9361-bbe3a396db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01c3ad0be0a46999d819df5fd6b699d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:28Z,use_quota=True,user_id='f0c643a8586b4a25a5780d182949fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Creating volume 595ea179-fc93-4405-9361-bbe3a396db0e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:27 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:27 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e 1073741824 Jul 25 02:35:27 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:28 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e 1073741824" returned: 0 in 0.574s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:28 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e Jul 25 02:35:28 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:28 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e" returned: 0 in 0.338s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Flow 'volume_create_manager' (bb88cfca-7ddd-4c0c-bb08-6e34988f1b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e43e35e-f88d-4019-b469-f95047ed8453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaa4747-3854-4a93-8443-59973e878744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595ea179-fc93-4405-9361-bbe3a396db0e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80e6947-6bc5-4a77-9e78-8003d7bc4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e43e35e-f88d-4019-b469-f95047ed8453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1399051440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71562348-59c0-452e-a3b6-3c1204be7b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8422f994bcf4e95aa0ecf7d8a5c1297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:29Z,use_quota=True,user_id='1508ab50a8674576bf86a352f0796b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cfeab0-08bd-473c-8364-1eff99fbae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cfeab0-08bd-473c-8364-1eff99fbae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76519c93-6bc8-4dd1-aaa2-28070274e352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76519c93-6bc8-4dd1-aaa2-28070274e352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71562348-59c0-452e-a3b6-3c1204be7b34', 'volume_name': 'volume-71562348-59c0-452e-a3b6-3c1204be7b34', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1d5f92-a4b9-48ec-a2ad-11c6c276f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1d5f92-a4b9-48ec-a2ad-11c6c276f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630df7f1-cc9a-4e9e-ba9d-9115b547dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:28 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Volume 71562348-59c0-452e-a3b6-3c1204be7b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71562348-59c0-452e-a3b6-3c1204be7b34', 'volume_size': 1} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1399051440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71562348-59c0-452e-a3b6-3c1204be7b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8422f994bcf4e95aa0ecf7d8a5c1297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:29Z,use_quota=True,user_id='1508ab50a8674576bf86a352f0796b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Creating volume 71562348-59c0-452e-a3b6-3c1204be7b34 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:28 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:28 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Volume volume-595ea179-fc93-4405-9361-bbe3a396db0e (595ea179-fc93-4405-9361-bbe3a396db0e): created successfully Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80e6947-6bc5-4a77-9e78-8003d7bc4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Flow 'volume_create_manager' (92423061-be9f-426e-95ad-ba0f6508f406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:28 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 1073741824 Jul 25 02:35:28 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:28 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d87ac44b-8544-40ec-bcf6-0769c451b899 tempest-VolumesTransfersV357Test-1452688615 None] Created volume successfully. Jul 25 02:35:29 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 1073741824" returned: 0 in 0.434s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:29 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 Jul 25 02:35:29 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:29 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630df7f1-cc9a-4e9e-ba9d-9115b547dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71562348-59c0-452e-a3b6-3c1204be7b34', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb850df-631c-456b-8e4b-3f4a13685267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Volume volume-71562348-59c0-452e-a3b6-3c1204be7b34 (71562348-59c0-452e-a3b6-3c1204be7b34): created successfully Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb850df-631c-456b-8e4b-3f4a13685267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Flow 'volume_create_manager' (bb88cfca-7ddd-4c0c-bb08-6e34988f1b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-cc01bc54-b788-4a3c-a218-1344f8a5979b tempest-ServersNegativeTestJSON-1234057021 None] Created volume successfully. Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Flow 'volume_create_manager' (b22f8fb0-96d7-49cd-8305-238fe1ee5bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e87168e-1a0e-4fd2-9cd8-57a5f878f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Acquiring lock "cinder-595ea179-fc93-4405-9361-bbe3a396db0e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e87168e-1a0e-4fd2-9cd8-57a5f878f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744203085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03090e1a-daae-458d-abd8-cb216b9db60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9439ad11361452399ae2a2388400bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:30Z,use_quota=True,user_id='4709f89c1df3472dabd0e583ccd6e2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7962d8e-851a-4b34-9276-e43b87aad043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7962d8e-851a-4b34-9276-e43b87aad043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf3bdf9-6cf3-4916-8102-b29f9d9174f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf3bdf9-6cf3-4916-8102-b29f9d9174f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03090e1a-daae-458d-abd8-cb216b9db60f', 'volume_name': 'volume-03090e1a-daae-458d-abd8-cb216b9db60f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0451ac6-b9c5-42e8-bca0-37c4cbe5d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0451ac6-b9c5-42e8-bca0-37c4cbe5d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb397d0-6d36-4261-84b2-7042df4b3caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:30 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Volume 03090e1a-daae-458d-abd8-cb216b9db60f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03090e1a-daae-458d-abd8-cb216b9db60f', 'volume_size': 1} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744203085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03090e1a-daae-458d-abd8-cb216b9db60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9439ad11361452399ae2a2388400bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:30Z,use_quota=True,user_id='4709f89c1df3472dabd0e583ccd6e2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Creating volume 03090e1a-daae-458d-abd8-cb216b9db60f {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:30 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-595ea179-fc93-4405-9361-bbe3a396db0e-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:30 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f 1073741824 Jul 25 02:35:30 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "cinder-71562348-59c0-452e-a3b6-3c1204be7b34-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Acquiring lock "cinder-quobyte-595ea179-fc93-4405-9361-bbe3a396db0e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-71562348-59c0-452e-a3b6-3c1204be7b34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-quobyte-595ea179-fc93-4405-9361-bbe3a396db0e" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db3fca-bd1e-44d2-8ba1-17dbc6829307]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "cinder-quobyte-71562348-59c0-452e-a3b6-3c1204be7b34" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-quobyte-71562348-59c0-452e-a3b6-3c1204be7b34" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0947fb1c-1229-4737-94bc-032bb2b806e8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:30 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e Jul 25 02:35:30 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:30 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 Jul 25 02:35:30 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:30 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f 1073741824" returned: 0 in 0.455s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:30 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e" returned: 0 in 0.380s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:30 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f Jul 25 02:35:30 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:30 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e Jul 25 02:35:30 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:30 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34" returned: 0 in 0.403s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:30 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34 Jul 25 02:35:30 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:30 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f" returned: 0 in 0.270s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:30 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb397d0-6d36-4261-84b2-7042df4b3caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03090e1a-daae-458d-abd8-cb216b9db60f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca79cb2-600f-47f9-98bc-2e788ed3b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-595ea179-fc93-4405-9361-bbe3a396db0e" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-quobyte-595ea179-fc93-4405-9361-bbe3a396db0e" released by "delete_volume" :: held 0.717s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:30 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Volume volume-03090e1a-daae-458d-abd8-cb216b9db60f (03090e1a-daae-458d-abd8-cb216b9db60f): created successfully Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca79cb2-600f-47f9-98bc-2e788ed3b712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Flow 'volume_create_manager' (b22f8fb0-96d7-49cd-8305-238fe1ee5bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-40299887-f577-4aac-9db1-076d15657c91 tempest-VolumesListAdminTestJSON-567878543 None] Created volume successfully. Jul 25 02:35:31 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-71562348-59c0-452e-a3b6-3c1204be7b34" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Created reservations ['fd756acd-4b65-442a-ab96-5469e702618c', 'c58af918-f6d2-4fcd-872e-b47f1852a39f', '157853dc-349b-40b7-a73d-855f045467d2', 'fca3f068-edca-4bad-835a-c11e08bcb479'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-quobyte-71562348-59c0-452e-a3b6-3c1204be7b34" released by "delete_volume" :: held 0.728s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Created reservations ['687a81aa-0766-4791-874b-c91739762b11', 'c1170302-d48a-4958-96be-faf85413ef3e', '52dead58-0f89-4920-9c1d-bf055561e7e4', 'b227fbb6-061a-43f8-b2f9-feb965d65439'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:31 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:31 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:31 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:31 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:31 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Deleted volume successfully. Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "cinder-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5d0c024-89ca-4f83-b454-0dd8a782a4a6 tempest-VolumesTransfersV357Test-108182141 None] Lock "cinder-595ea179-fc93-4405-9361-bbe3a396db0e-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:31 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.259s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "cinder-quobyte-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Deleted volume successfully. Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-quobyte-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec254ace-dd1a-4f86-9549-fb4d4c9876a8 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-71562348-59c0-452e-a3b6-3c1204be7b34-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e115759-c72f-44ab-9d96-26ebad830dd0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:31 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 Jul 25 02:35:31 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:31 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0" returned: 0 in 0.353s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:31 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0 Jul 25 02:35:31 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:32 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0" returned: 0 in 0.274s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-quobyte-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0" released by "delete_volume" :: held 0.670s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Created reservations ['b6ed6c45-be0f-42be-860c-dc2dd6f142bd', 'bb6ab9ac-f553-4eb1-a9fc-ecda4d093bfb', 'd0c417d7-a923-41cf-93f5-852a9148d416', '2b12dffe-99a0-40ea-b46a-e119cb17eb2d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:32 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:32 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:32 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.324s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Deleted volume successfully. Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Flow 'volume_create_manager' (d28707e1-6d33-4c55-9ef5-ca6600b4e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa22dec-2b00-4d47-94f0-d85b79cbe5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-51ce31b9-dcef-4d45-aee9-d62f03b2e0e7 tempest-ServersNegativeTestJSON-1234057021 None] Lock "cinder-d386adad-3ebf-43d1-8ff6-3a5be4f03ec0-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa22dec-2b00-4d47-94f0-d85b79cbe5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-331425629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337c8da0-ffd7-4bad-a5f1-8a5a1586ec49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9439ad11361452399ae2a2388400bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:33Z,use_quota=True,user_id='4709f89c1df3472dabd0e583ccd6e2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de4aeb7-0725-400a-aac4-736d50668ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de4aeb7-0725-400a-aac4-736d50668ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ea559e-de78-470b-8d5e-e56687ac1079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ea559e-de78-470b-8d5e-e56687ac1079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337c8da0-ffd7-4bad-a5f1-8a5a1586ec49', 'volume_name': 'volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4830fb4-6161-439b-8e0a-e4e30b938acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4830fb4-6161-439b-8e0a-e4e30b938acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f424f7e5-8ed7-47f4-b800-f5d7fedd3b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Volume 337c8da0-ffd7-4bad-a5f1-8a5a1586ec49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49', 'volume_size': 1} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-331425629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337c8da0-ffd7-4bad-a5f1-8a5a1586ec49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9439ad11361452399ae2a2388400bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:33Z,use_quota=True,user_id='4709f89c1df3472dabd0e583ccd6e2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Creating volume 337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:32 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:32 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 1073741824 Jul 25 02:35:32 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:33 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 1073741824" returned: 0 in 0.656s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:33 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 Jul 25 02:35:33 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:33 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49" returned: 0 in 0.339s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f424f7e5-8ed7-47f4-b800-f5d7fedd3b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2456fb3-4cf9-432c-a5da-bbefe29b37ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:34 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Volume volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 (337c8da0-ffd7-4bad-a5f1-8a5a1586ec49): created successfully Jul 25 02:35:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2456fb3-4cf9-432c-a5da-bbefe29b37ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Flow 'volume_create_manager' (d28707e1-6d33-4c55-9ef5-ca6600b4e966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6873b988-7d07-4884-bc24-4b35b6291a60 tempest-VolumesListAdminTestJSON-567878543 None] Created volume successfully. Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Flow 'volume_create_manager' (6f8cb20d-654d-4f38-95cd-f1cc74fc8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b290d7f7-59a4-4ebc-bf2c-f2a75d668140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b290d7f7-59a4-4ebc-bf2c-f2a75d668140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364380699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c466633-8185-4392-bcf5-3f2ffe5fa724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9439ad11361452399ae2a2388400bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:35Z,use_quota=True,user_id='4709f89c1df3472dabd0e583ccd6e2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ba0369-f519-4db5-8d70-166873a41f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ba0369-f519-4db5-8d70-166873a41f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a9598f-ae7d-492d-afd4-fcdfeb8e2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a9598f-ae7d-492d-afd4-fcdfeb8e2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c466633-8185-4392-bcf5-3f2ffe5fa724', 'volume_name': 'volume-3c466633-8185-4392-bcf5-3f2ffe5fa724', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8ab6af-bd2d-4860-9fdc-c80682a1f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8ab6af-bd2d-4860-9fdc-c80682a1f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619f6676-71db-4d67-8ff8-e49fc3531b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:35 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Volume 3c466633-8185-4392-bcf5-3f2ffe5fa724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c466633-8185-4392-bcf5-3f2ffe5fa724', 'volume_size': 1} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364380699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c466633-8185-4392-bcf5-3f2ffe5fa724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9439ad11361452399ae2a2388400bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:35Z,use_quota=True,user_id='4709f89c1df3472dabd0e583ccd6e2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Creating volume 3c466633-8185-4392-bcf5-3f2ffe5fa724 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:35 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:35 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 1073741824 Jul 25 02:35:35 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:36 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 1073741824" returned: 0 in 0.828s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:36 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 Jul 25 02:35:36 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:36 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724" returned: 0 in 0.285s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619f6676-71db-4d67-8ff8-e49fc3531b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c466633-8185-4392-bcf5-3f2ffe5fa724', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c000100-314b-4594-a3e3-fa70614fb05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:36 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Volume volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 (3c466633-8185-4392-bcf5-3f2ffe5fa724): created successfully Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c000100-314b-4594-a3e3-fa70614fb05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Flow 'volume_create_manager' (6f8cb20d-654d-4f38-95cd-f1cc74fc8583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7efbc247-610b-4cc7-a5b5-d8fbc606dca6 tempest-VolumesListAdminTestJSON-567878543 None] Created volume successfully. Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Flow 'volume_create_manager' (363335d2-48e1-499a-9b3c-b78f77bb8194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876c69a9-8535-4c2c-b6cb-121468a0569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876c69a9-8535-4c2c-b6cb-121468a0569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26c4adb-dc21-4471-a608-dcd6488f161c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a2d776b8ce42988c88ca3bc80fd2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:39Z,use_quota=True,user_id='b6ddf94779134f44a193f8d9a062fa82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8dfb53-6f77-4bf0-87c1-bc07414dc315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8dfb53-6f77-4bf0-87c1-bc07414dc315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abfe593-dcdd-4bde-a060-fd976634ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abfe593-dcdd-4bde-a060-fd976634ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26c4adb-dc21-4471-a608-dcd6488f161c', 'volume_name': 'volume-e26c4adb-dc21-4471-a608-dcd6488f161c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc0c3b5-4014-4eaf-8785-eb19e4faced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc0c3b5-4014-4eaf-8785-eb19e4faced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ed5b86-456d-4fe4-90fd-dfce67049959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Volume e26c4adb-dc21-4471-a608-dcd6488f161c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26c4adb-dc21-4471-a608-dcd6488f161c', 'volume_size': 1} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26c4adb-dc21-4471-a608-dcd6488f161c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a2d776b8ce42988c88ca3bc80fd2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:39Z,use_quota=True,user_id='b6ddf94779134f44a193f8d9a062fa82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Creating volume e26c4adb-dc21-4471-a608-dcd6488f161c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:39 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:39 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c 1073741824 Jul 25 02:35:39 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:39 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c 1073741824" returned: 0 in 0.525s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:39 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c Jul 25 02:35:39 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:39 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c" returned: 0 in 0.325s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ed5b86-456d-4fe4-90fd-dfce67049959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26c4adb-dc21-4471-a608-dcd6488f161c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d13fabf-1afb-46f8-b52c-55def515afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Volume volume-e26c4adb-dc21-4471-a608-dcd6488f161c (e26c4adb-dc21-4471-a608-dcd6488f161c): created successfully Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d13fabf-1afb-46f8-b52c-55def515afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Flow 'volume_create_manager' (363335d2-48e1-499a-9b3c-b78f77bb8194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9c46bbdc-373a-4f28-a18c-2af72e334f2b tempest-VolumesListAdminTestJSON-946452611 None] Created volume successfully. Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Acquiring lock "cinder-e26c4adb-dc21-4471-a608-dcd6488f161c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Lock "cinder-e26c4adb-dc21-4471-a608-dcd6488f161c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Acquiring lock "cinder-quobyte-e26c4adb-dc21-4471-a608-dcd6488f161c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Lock "cinder-quobyte-e26c4adb-dc21-4471-a608-dcd6488f161c" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b2af4-5130-4321-9ad4-bb4741b24cb2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "cinder-3c466633-8185-4392-bcf5-3f2ffe5fa724-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-3c466633-8185-4392-bcf5-3f2ffe5fa724-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "cinder-quobyte-3c466633-8185-4392-bcf5-3f2ffe5fa724" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-quobyte-3c466633-8185-4392-bcf5-3f2ffe5fa724" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:41 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c Jul 25 02:35:41 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a576113d-0340-466e-99a2-96052fe0b138]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:41 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 Jul 25 02:35:41 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:41 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c" returned: 0 in 0.509s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:41 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c Jul 25 02:35:41 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:41 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724" returned: 0 in 0.503s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:42 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724 Jul 25 02:35:42 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Acquiring lock "cinder-5f4762a9-d0b7-40e5-9fa1-38d66990d019-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:42 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e26c4adb-dc21-4471-a608-dcd6488f161c" returned: 0 in 0.397s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "cinder-5f4762a9-d0b7-40e5-9fa1-38d66990d019-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Lock "cinder-quobyte-e26c4adb-dc21-4471-a608-dcd6488f161c" released by "delete_volume" :: held 1.015s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Acquiring lock "cinder-quobyte-5f4762a9-d0b7-40e5-9fa1-38d66990d019" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "cinder-quobyte-5f4762a9-d0b7-40e5-9fa1-38d66990d019" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:42 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3c466633-8185-4392-bcf5-3f2ffe5fa724" returned: 0 in 0.341s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[35226783-714a-4f1a-86d0-12ad5b9b1d67]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Created reservations ['325f09e3-2b89-44bd-885f-4adb3c02c73d', 'f1e00f64-31ba-4724-983e-59e121b2e859', 'b99c72f8-0f37-4e92-9e8b-a3ee4d29833e', 'd4b9a07e-e5fd-4d8f-b656-fb1434d4891c'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-quobyte-3c466633-8185-4392-bcf5-3f2ffe5fa724" released by "delete_volume" :: held 0.911s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Created reservations ['0810c86d-c9c6-4be8-a556-2e2ff75f9623', 'b78a0b21-9a1c-4512-bc67-81a26aad90b8', '5c770613-75a3-4553-965b-f584860c2a15', '02b2a085-f246-4e9a-a4bc-5b3cc8e09d1f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:42 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 Jul 25 02:35:42 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:42 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:42 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:42 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:42 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "cinder-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "cinder-quobyte-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-quobyte-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e45d2-0f88-4955-afe2-a23a37d87cf8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:43 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.496s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:43 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Deleted volume successfully. Jul 25 02:35:43 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.447s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:43 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Deleted volume successfully. Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-42e6eaf6-ae81-43b1-858c-4d2c014acd22 tempest-VolumesListAdminTestJSON-946452611 None] Lock "cinder-e26c4adb-dc21-4471-a608-dcd6488f161c-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:43 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019" returned: 0 in 0.791s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c061074-0467-4549-b8f0-4ba01b8964a7 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-3c466633-8185-4392-bcf5-3f2ffe5fa724-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:43 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 Jul 25 02:35:43 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:43 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019 Jul 25 02:35:43 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:43 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5f4762a9-d0b7-40e5-9fa1-38d66990d019" returned: 0 in 0.324s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "cinder-quobyte-5f4762a9-d0b7-40e5-9fa1-38d66990d019" released by "delete_volume" :: held 1.183s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:43 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49" returned: 0 in 0.503s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:43 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49 Jul 25 02:35:43 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Created reservations ['f04234a9-fbdf-497c-b724-b146bb13796b', '36ec18eb-5b26-488b-b8e5-cf8bb1d5aace', '127a9841-432d-4652-bf34-bb38d35e3eef', '9b152747-07f1-425b-9efc-285d2eb0541e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:43 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:43 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:43 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-quobyte-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49" released by "delete_volume" :: held 0.862s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Created reservations ['f87b38a7-2a4d-42e2-b2d6-d7695a3e5191', '4e334d3b-9458-4958-b3b5-13d723771707', '3b65bbb8-09aa-4d49-8a66-e3c6ea1ea256', '9d55b0f9-7485-4444-a06c-13704028845d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:43 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.351s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:43 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Deleted volume successfully. Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c41a4028-a064-4d69-9573-0ea3c895a3ce tempest-AttachVolumeShelveTestJSON-1324956417 None] Lock "cinder-5f4762a9-d0b7-40e5-9fa1-38d66990d019-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:44 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:44 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "cinder-03090e1a-daae-458d-abd8-cb216b9db60f-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-03090e1a-daae-458d-abd8-cb216b9db60f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "cinder-quobyte-03090e1a-daae-458d-abd8-cb216b9db60f" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-quobyte-03090e1a-daae-458d-abd8-cb216b9db60f" acquired by "delete_volume" :: waited 0.077s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8faf446-d900-40dd-bd59-0157c66a7d33]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:44 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.586s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Deleted volume successfully. Jul 25 02:35:44 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f Jul 25 02:35:44 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dc72f72-e595-4aef-bc22-92ced8ba9015 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-337c8da0-ffd7-4bad-a5f1-8a5a1586ec49-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:44 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f" returned: 0 in 0.467s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:45 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f Jul 25 02:35:45 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:45 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03090e1a-daae-458d-abd8-cb216b9db60f" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-quobyte-03090e1a-daae-458d-abd8-cb216b9db60f" released by "delete_volume" :: held 0.851s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Created reservations ['10938e00-b97d-4109-b9f5-6b0ea7168c0b', '20787df7-1ffa-44b8-b66c-cea95ada1939', '289e3d3b-22c0-46f4-ac73-f87ddc36e2ce', 'edd573e2-f343-4b84-88fa-59b4fc3de872'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:45 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:45 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:45 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.296s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Deleted volume successfully. Jul 25 02:35:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-57cb6f75-0797-485e-904a-54a45df8d498 tempest-VolumesListAdminTestJSON-567878543 None] Lock "cinder-03090e1a-daae-458d-abd8-cb216b9db60f-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:50 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:35:50 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:35:51 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 25 02:35:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.307s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:35:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:35:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:35:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 8 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:35:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:35:55 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=93,cinder:INSERT=20,cinder:SELECT=65,cinder:DELETE=7 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:35:55 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=87,cinder:INSERT=36,cinder:UPDATE=142,cinder:DELETE=13 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Flow 'volume_create_manager' (fbc31511-040f-4ba8-970a-258c231b5faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423f0c3e-9ed2-4d83-b750-7e0022b9cd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423f0c3e-9ed2-4d83-b750-7e0022b9cd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1923593291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8ffd75-39bd-40ef-a2aa-a97921728806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a53a2b32e6054fc4a1eb698cf8d7d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:59Z,use_quota=True,user_id='e727d06af99a4fe1b63192000188df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e1aa13-d9d5-42c3-a9cd-f0c6c96fe42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e1aa13-d9d5-42c3-a9cd-f0c6c96fe42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd47946-1045-4f04-850d-d12156eb25c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd47946-1045-4f04-850d-d12156eb25c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8ffd75-39bd-40ef-a2aa-a97921728806', 'volume_name': 'volume-1f8ffd75-39bd-40ef-a2aa-a97921728806', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45613ee-0f9a-4159-ad2b-21ba35d47682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45613ee-0f9a-4159-ad2b-21ba35d47682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f472b9c8-8b7e-4467-b4f9-a59672dce67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:35:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Volume 1f8ffd75-39bd-40ef-a2aa-a97921728806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8ffd75-39bd-40ef-a2aa-a97921728806', 'volume_size': 1} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1923593291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8ffd75-39bd-40ef-a2aa-a97921728806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a53a2b32e6054fc4a1eb698cf8d7d240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:35:59Z,use_quota=True,user_id='e727d06af99a4fe1b63192000188df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Creating volume 1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:35:59 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:35:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:35:59 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 1073741824 Jul 25 02:35:59 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:00 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 1073741824" returned: 0 in 0.770s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:00 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 Jul 25 02:36:00 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:00 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f472b9c8-8b7e-4467-b4f9-a59672dce67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8ffd75-39bd-40ef-a2aa-a97921728806', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceeb1b3-e463-431a-a78e-1faadb5ea790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Volume volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 (1f8ffd75-39bd-40ef-a2aa-a97921728806): created successfully Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceeb1b3-e463-431a-a78e-1faadb5ea790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Flow 'volume_create_manager' (fbc31511-040f-4ba8-970a-258c231b5faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-59e55166-49b5-4570-908a-5f19b48c9603 req-c85e36ac-1d74-4490-af57-2b03b5169fee tempest-VolumesSnapshotsTestJSON-111062241 None] Created volume successfully. Jul 25 02:36:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Creating offline snapshot 444ae644-24fd-4a86-b1e1-9fdff77ee653 of volume 1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:36:01 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab8e72-a5c8-4b2a-914b-1512bbee4165]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:01 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 Jul 25 02:36:01 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:02 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806" returned: 0 in 0.589s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:02 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 1G Jul 25 02:36:02 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:02 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 1G" returned: 0 in 0.664s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:02 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 Jul 25 02:36:02 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:03 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:03 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 is being set with open permissions: ugo+rw Jul 25 02:36:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:03 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 Jul 25 02:36:03 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:03 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:03 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info Jul 25 02:36:03 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:03 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info" returned: 0 in 0.304s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:03 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info is being set with open permissions: ugo+rw Jul 25 02:36:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:04 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info Jul 25 02:36:04 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Flow 'volume_create_manager' (a7cf420f-71a5-4dea-b764-3989bc80158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f969436-0569-4f5f-90b7-c2c29b184e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f969436-0569-4f5f-90b7-c2c29b184e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533176764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e658ab2d-f94a-4626-b26b-46acfa82464c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338bfed51c5e4ee6bc4ad9398fb46e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:04Z,use_quota=True,user_id='8c48abfd45ed47e3b4c9af492c3b14ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c54b92d-450e-4b0b-88f6-4be30ae3e611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c54b92d-450e-4b0b-88f6-4be30ae3e611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd13e71-5780-4bc0-a021-b3050a4201e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd13e71-5780-4bc0-a021-b3050a4201e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e658ab2d-f94a-4626-b26b-46acfa82464c', 'volume_name': 'volume-e658ab2d-f94a-4626-b26b-46acfa82464c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e2b29a-34b5-4c76-a6d5-0c02de7828ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e2b29a-34b5-4c76-a6d5-0c02de7828ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de79c119-3957-4388-a9c2-d1f6cd1b31c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Volume e658ab2d-f94a-4626-b26b-46acfa82464c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e658ab2d-f94a-4626-b26b-46acfa82464c', 'volume_size': 1} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:04 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.info" returned: 0 in 0.355s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.240s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533176764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e658ab2d-f94a-4626-b26b-46acfa82464c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338bfed51c5e4ee6bc4ad9398fb46e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:04Z,use_quota=True,user_id='8c48abfd45ed47e3b4c9af492c3b14ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Creating volume e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:04 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:04 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c 1073741824 Jul 25 02:36:04 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-89b96e06-4e1b-4784-bfe7-c30d693c4188 req-d85e99c0-8a49-4bf1-938f-fe40f2d0fbc7 tempest-VolumesSnapshotsTestJSON-111062241 None] Create snapshot completed successfully Jul 25 02:36:05 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c 1073741824" returned: 0 in 0.614s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:05 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:05 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:05 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "cinder-444ae644-24fd-4a86-b1e1-9fdff77ee653-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de79c119-3957-4388-a9c2-d1f6cd1b31c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e658ab2d-f94a-4626-b26b-46acfa82464c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc05d876-ad25-413b-884a-2e77d24cac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-444ae644-24fd-4a86-b1e1-9fdff77ee653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "cinder-quobyte-1f8ffd75-39bd-40ef-a2aa-a97921728806" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:05 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Volume volume-e658ab2d-f94a-4626-b26b-46acfa82464c (e658ab2d-f94a-4626-b26b-46acfa82464c): created successfully Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc05d876-ad25-413b-884a-2e77d24cac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Flow 'volume_create_manager' (a7cf420f-71a5-4dea-b764-3989bc80158b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-71a57970-9792-4a42-b417-5f7c63ab465d tempest-VolumesDeleteCascade-599046930 None] Created volume successfully. Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-quobyte-1f8ffd75-39bd-40ef-a2aa-a97921728806" acquired by "delete_snapshot" :: waited 0.055s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "cinder-quobyte-444ae644-24fd-4a86-b1e1-9fdff77ee653" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-quobyte-444ae644-24fd-4a86-b1e1-9fdff77ee653" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Deleting offline snapshot 444ae644-24fd-4a86-b1e1-9fdff77ee653 of volume 1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] snapshot_file for this snap is: volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c619ac-50ee-4aa8-8d88-24f98c483c05]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:05 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 Jul 25 02:36:05 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:06 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653" returned: 0 in 0.502s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8ffd75-39bd-40ef-a2aa-a97921728806(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dccca38-24a0-4c7a-a0d6-f29aa51e86a4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:06 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 Jul 25 02:36:06 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Creating offline snapshot 89f93d99-ee73-4b8f-8848-70cd05a05b58 of volume e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2c1ac2-eeb4-4506-a6e8-4d4e3d9f341c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:06 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:06 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:06 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806" returned: 0 in 0.568s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:06 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 Jul 25 02:36:06 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:06 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.593s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:07 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 1G Jul 25 02:36:07 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:07 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653" returned: 0 in 0.534s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:07 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653 Jul 25 02:36:07 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:07 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806.444ae644-24fd-4a86-b1e1-9fdff77ee653" returned: 0 in 0.348s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:07 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 1G" returned: 0 in 0.570s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:07 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:07 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-quobyte-444ae644-24fd-4a86-b1e1-9fdff77ee653" released by "_delete_snapshot" :: held 2.121s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-quobyte-1f8ffd75-39bd-40ef-a2aa-a97921728806" released by "delete_snapshot" :: held 2.157s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG cinder.quota [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Created reservations ['bab270b2-3b82-42ec-81ff-e86b8a1690db', 'b6b0a127-41e3-4084-b6b1-eb4a524e6564', '9ed521fd-b984-4da5-9bcb-af14cba859b0', 'd751fb07-1204-4179-9561-06c19295b0a8'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Delete snapshot completed successfully. Jul 25 02:36:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-f014b61e-56ba-48ef-a710-82a1e70e6ea1 req-26da5797-d15d-4c83-aa6c-f9a0c1da447f tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-444ae644-24fd-4a86-b1e1-9fdff77ee653-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "cinder-1f8ffd75-39bd-40ef-a2aa-a97921728806-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-1f8ffd75-39bd-40ef-a2aa-a97921728806-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:08 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.502s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:08 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 is being set with open permissions: ugo+rw Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:08 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:08 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "cinder-quobyte-1f8ffd75-39bd-40ef-a2aa-a97921728806" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-quobyte-1f8ffd75-39bd-40ef-a2aa-a97921728806" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8b4f7-9ff6-4f7d-9f08-a5035c4dfa23]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:08 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 Jul 25 02:36:08 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:08 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.316s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:08 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info Jul 25 02:36:08 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:08 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806" returned: 0 in 0.517s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:08 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806 Jul 25 02:36:08 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:08 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:08 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info is being set with open permissions: ugo+rw Jul 25 02:36:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:08 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info Jul 25 02:36:08 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:09 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1f8ffd75-39bd-40ef-a2aa-a97921728806" returned: 0 in 0.293s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-quobyte-1f8ffd75-39bd-40ef-a2aa-a97921728806" released by "delete_volume" :: held 0.917s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:09 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.info" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.quota [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Created reservations ['e306fa1b-77b3-4b85-ace8-e7dd5d3db7dc', '732c80b4-b50c-4459-b071-3a6b210f5813', 'c0077b97-1ee4-4fa3-95b6-98a6b21f92a7', 'ba134017-1f70-4d4c-ad3d-952997383754'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b195b71c-043a-4adb-87db-159d604f0643 tempest-VolumesDeleteCascade-599046930 None] Create snapshot completed successfully Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:09 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:09 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:09 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.manager [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Deleted volume successfully. Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-adcf6ac2-43a2-4e7e-97be-3bfdb5cd5ad4 req-fc1d8116-511a-4870-a766-27d431f683d1 tempest-VolumesSnapshotsTestJSON-111062241 None] Lock "cinder-1f8ffd75-39bd-40ef-a2aa-a97921728806-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Creating offline snapshot abc87c83-f51e-4d4d-a353-c45dc6c6fb9f of volume e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef0005c-77b9-4e74-bebd-5508d4892db1]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:10 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:10 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:10 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.547s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e658ab2d-f94a-4626-b26b-46acfa82464c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:10 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f 1G Jul 25 02:36:10 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:11 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f 1G" returned: 0 in 0.577s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:11 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f Jul 25 02:36:11 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:11 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" returned: 0 in 0.344s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:11 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f is being set with open permissions: ugo+rw Jul 25 02:36:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:11 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f Jul 25 02:36:11 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:11 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" returned: 0 in 0.317s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ebb3610b-0bbd-47d0-9058-263ff3cbfed8 tempest-VolumesDeleteCascade-599046930 None] Create snapshot completed successfully Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-e658ab2d-f94a-4626-b26b-46acfa82464c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-e658ab2d-f94a-4626-b26b-46acfa82464c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Performing cascade delete. {{(pid=88279) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-89f93d99-ee73-4b8f-8848-70cd05a05b58-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-89f93d99-ee73-4b8f-8848-70cd05a05b58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-89f93d99-ee73-4b8f-8848-70cd05a05b58" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-89f93d99-ee73-4b8f-8848-70cd05a05b58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Deleting offline snapshot 89f93d99-ee73-4b8f-8848-70cd05a05b58 of volume e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] snapshot_file for this snap is: volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a5083-c4a2-40d6-b6c2-fe81662af136]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:12 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:12 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:12 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.587s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e658ab2d-f94a-4626-b26b-46acfa82464c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd662fe-55c1-4f43-b765-72b47ee1a70d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:13 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:13 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:13 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.570s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d832e6-9594-4ead-99a5-de9cbab8ef10]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:13 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f Jul 25 02:36:13 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:14 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" returned: 0 in 0.858s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e658ab2d-f94a-4626-b26b-46acfa82464c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f8706-1073-439c-9fa4-6f7c848aebb7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:14 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:14 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:15 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.940s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e658ab2d-f94a-4626-b26b-46acfa82464c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:15 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4564f8b-ed3a-419a-8b7a-ad742d74beb8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-604f4505-8bf5-4ca5-8d39-399fc9b762b3 tempest-BackendsCapabilitiesAdminTestsJSON-30557535 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88279) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 25 02:36:15 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:15 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:15 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-80bc5635-075a-4e20-9dcd-74d9d5926e1f tempest-BackendsCapabilitiesAdminTestsJSON-30557535 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88279) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 25 02:36:16 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.586s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:16 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:16 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:16 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.621s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:16 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58 Jul 25 02:36:16 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:17 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.89f93d99-ee73-4b8f-8848-70cd05a05b58" returned: 0 in 0.450s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f -F qcow2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:17 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f -F qcow2 Jul 25 02:36:17 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:17 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e658ab2d-f94a-4626-b26b-46acfa82464c /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f -F qcow2" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-89f93d99-ee73-4b8f-8848-70cd05a05b58" released by "_delete_snapshot" :: held 5.424s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" released by "delete_snapshot" :: held 5.467s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Created reservations ['6516d188-d7bb-4a61-a4af-8f1599c1a5f1', '0d04793d-1cbb-4702-b193-477e553687e6', 'ac84b895-a470-49ca-bcb7-f5db540bc5d5', '4e6a4ac7-a35e-4ff2-85ec-018fe23696ee'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Delete snapshot completed successfully. Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-89f93d99-ee73-4b8f-8848-70cd05a05b58-delete_snapshot" released by "delete_snapshot" :: held 5.772s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-abc87c83-f51e-4d4d-a353-c45dc6c6fb9f-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-abc87c83-f51e-4d4d-a353-c45dc6c6fb9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Deleting offline snapshot abc87c83-f51e-4d4d-a353-c45dc6c6fb9f of volume e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] snapshot_file for this snap is: volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[11347ee1-d1fd-4074-864e-da67a99bffe7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:18 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f Jul 25 02:36:18 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:18 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" returned: 0 in 0.543s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e658ab2d-f94a-4626-b26b-46acfa82464c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46d755-70f6-4c22-a2fb-9416287bcb71]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:18 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:18 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:19 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.613s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:19 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f Jul 25 02:36:19 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:20 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" returned: 0 in 1.017s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:20 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f Jul 25 02:36:20 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:20 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c.abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" returned: 0 in 0.463s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-abc87c83-f51e-4d4d-a353-c45dc6c6fb9f" released by "_delete_snapshot" :: held 2.859s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" released by "delete_snapshot" :: held 2.920s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Created reservations ['e5ba2134-e1c3-4cfd-88c7-ff918689c60f', 'aa524499-02f4-4986-baa5-4d3683139484', '06a722f5-099c-4093-9465-3af5784a4c68', '46d211d5-e476-41c0-a537-17598f559962'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:21 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Delete snapshot completed successfully. Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-abc87c83-f51e-4d4d-a353-c45dc6c6fb9f-delete_snapshot" released by "delete_snapshot" :: held 3.435s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Snapshots deleted, issuing volume delete {{(pid=88279) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2c37cc-bb11-44d5-ba66-dbc2008ce22a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:21 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:21 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:22 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.636s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:22 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c Jul 25 02:36:22 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:22 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e658ab2d-f94a-4626-b26b-46acfa82464c" returned: 0 in 0.754s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-e658ab2d-f94a-4626-b26b-46acfa82464c" released by "delete_volume" :: held 1.534s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Created reservations ['7009e342-c6fa-4a0a-a5cd-e70270bbd383', '009eade9-5b86-40f6-b69b-ca30c5a937b2', '8a861fbe-7aa5-4a25-81db-7984fc9f572b', 'c6531047-4b64-429c-86de-aa02b22bafaf'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:23 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:23 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:24 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.799s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:24 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:24 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Deleted volume successfully. Jul 25 02:36:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ada645f-3280-45d0-8492-c9259b0cbdd2 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-e658ab2d-f94a-4626-b26b-46acfa82464c-delete_volume" released by "delete_volume" :: held 12.198s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Flow 'volume_create_manager' (d7fbaf37-303b-4106-9cf9-182931f7e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c66bb40-82d5-4226-81b1-ca4e3038bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c66bb40-82d5-4226-81b1-ca4e3038bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1433124348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d7a10a-5549-4aa4-9fe0-f088419e8da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338bfed51c5e4ee6bc4ad9398fb46e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:25Z,use_quota=True,user_id='8c48abfd45ed47e3b4c9af492c3b14ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20f990-6b18-4ec5-9f78-8f5e2ed08af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20f990-6b18-4ec5-9f78-8f5e2ed08af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e93160-d5a5-4631-9eff-590a5e62bcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e93160-d5a5-4631-9eff-590a5e62bcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d7a10a-5549-4aa4-9fe0-f088419e8da4', 'volume_name': 'volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57189c75-08d8-4c83-ba97-2826d5eca823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57189c75-08d8-4c83-ba97-2826d5eca823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d051b9-70e2-41e4-a476-ab124c8befe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:25 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Volume c4d7a10a-5549-4aa4-9fe0-f088419e8da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4', 'volume_size': 1} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1433124348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d7a10a-5549-4aa4-9fe0-f088419e8da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338bfed51c5e4ee6bc4ad9398fb46e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:25Z,use_quota=True,user_id='8c48abfd45ed47e3b4c9af492c3b14ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Creating volume c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:25 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:25 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 1073741824 Jul 25 02:36:25 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:26 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 1073741824" returned: 0 in 0.919s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:26 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:26 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-248cfe2d-4c61-443c-9f31-a8c5133ab34e tempest-GroupSnapshotsV319Test-433907128 None] Group tempest-GroupSnapshotsV319Test-Group-548811647: creating Jul 25 02:36:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-248cfe2d-4c61-443c-9f31-a8c5133ab34e tempest-GroupSnapshotsV319Test-433907128 None] Group tempest-GroupSnapshotsV319Test-Group-548811647: created successfully Jul 25 02:36:27 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-248cfe2d-4c61-443c-9f31-a8c5133ab34e tempest-GroupSnapshotsV319Test-433907128 None] Create group completed successfully. Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.556s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d051b9-70e2-41e4-a476-ab124c8befe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c7ff5d-ba14-4e0e-b040-64913e929fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Volume volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 (c4d7a10a-5549-4aa4-9fe0-f088419e8da4): created successfully Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c7ff5d-ba14-4e0e-b040-64913e929fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Flow 'volume_create_manager' (d7fbaf37-303b-4106-9cf9-182931f7e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-588ea317-95c3-4e6e-ab8d-217aa724227f tempest-VolumesDeleteCascade-599046930 None] Created volume successfully. Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Creating offline snapshot 44c16f52-6085-4b80-92ec-a0182f65a6ac of volume c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9848da1a-5935-4569-8381-21b064e5627b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:28 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:28 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:28 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.595s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:28 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac 1G Jul 25 02:36:28 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Flow 'volume_create_manager' (ffd65fb3-c5e7-409d-8355-439ef6c8434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c5147b-f219-470a-8b74-366f14eb5d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c5147b-f219-470a-8b74-366f14eb5d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1507831158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bee117aa-529d-46bb-bee0-8182f065e98c,host='devstack@QuobyteHD#QuobyteHD',id=20a7883a-d0b6-4257-87e2-f4057010b161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aa2e5ca1394936ba23611fa6b3e4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:29Z,use_quota=True,user_id='d10f6f3d99764c999f22db1ce4589260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c552c-e09a-4356-9336-1f4385e7ed6f),volume_type_id=6c2c552c-e09a-4356-9336-1f4385e7ed6f)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce99ee-e028-4b2f-ba6a-24c85834f3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce99ee-e028-4b2f-ba6a-24c85834f3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5906e5be-d062-434d-8a41-5026c3758a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5906e5be-d062-434d-8a41-5026c3758a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a7883a-d0b6-4257-87e2-f4057010b161', 'volume_name': 'volume-20a7883a-d0b6-4257-87e2-f4057010b161', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc0d596-ee68-48b8-ac06-858d005f98c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc0d596-ee68-48b8-ac06-858d005f98c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616899c2-50cb-444d-a080-9c132521ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Volume 20a7883a-d0b6-4257-87e2-f4057010b161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a7883a-d0b6-4257-87e2-f4057010b161', 'volume_size': 1} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:29 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac 1G" returned: 0 in 1.150s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:29 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac Jul 25 02:36:29 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:30 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac" returned: 0 in 0.353s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:30 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac is being set with open permissions: ugo+rw Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:30 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac Jul 25 02:36:30 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:30 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:30 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info Jul 25 02:36:30 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:30 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:30 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info is being set with open permissions: ugo+rw Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:30 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info Jul 25 02:36:30 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:30 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.info" returned: 0 in 0.286s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.038s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bee117aa-529d-46bb-bee0-8182f065e98c,created_at=2026-07-25T00:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1507831158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bee117aa-529d-46bb-bee0-8182f065e98c,host='devstack@QuobyteHD#QuobyteHD',id=20a7883a-d0b6-4257-87e2-f4057010b161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aa2e5ca1394936ba23611fa6b3e4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:29Z,use_quota=True,user_id='d10f6f3d99764c999f22db1ce4589260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c552c-e09a-4356-9336-1f4385e7ed6f),volume_type_id=6c2c552c-e09a-4356-9336-1f4385e7ed6f)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Creating volume 20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:30 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:31 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 1073741824 Jul 25 02:36:31 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-75d6e1fa-7cd0-4189-8159-4fddd66d5970 tempest-VolumesDeleteCascade-599046930 None] Create snapshot completed successfully Jul 25 02:36:31 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 1073741824" returned: 0 in 0.487s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:31 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 Jul 25 02:36:31 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Flow 'volume_create_manager' (96105376-8917-4a6f-888b-a965418ff98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdca2f6-8865-44a4-9a51-a35f57fd7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdca2f6-8865-44a4-9a51-a35f57fd7947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1574193890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e22c667-b044-4d82-99d9-4873a86870c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338bfed51c5e4ee6bc4ad9398fb46e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44c16f52-6085-4b80-92ec-a0182f65a6ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:32Z,use_quota=True,user_id='8c48abfd45ed47e3b4c9af492c3b14ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f6929b-0881-49f4-8658-12e91ac89acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f6929b-0881-49f4-8658-12e91ac89acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa96bd4-6a8c-46ee-99a1-7eb35c179120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa96bd4-6a8c-46ee-99a1-7eb35c179120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e22c667-b044-4d82-99d9-4873a86870c7', 'volume_name': 'volume-2e22c667-b044-4d82-99d9-4873a86870c7', 'volume_size': 1, 'snapshot_id': '44c16f52-6085-4b80-92ec-a0182f65a6ac'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9f4f1c-e650-4c7a-be61-bd9a0ff5da58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9f4f1c-e650-4c7a-be61-bd9a0ff5da58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42181fb7-c205-4548-a8fe-662e41781e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Volume 2e22c667-b044-4d82-99d9-4873a86870c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e22c667-b044-4d82-99d9-4873a86870c7', 'volume_size': 1, 'snapshot_id': '44c16f52-6085-4b80-92ec-a0182f65a6ac'} Jul 25 02:36:31 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161" returned: 0 in 0.296s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-44c16f52-6085-4b80-92ec-a0182f65a6ac-2e22c667-b044-4d82-99d9-4873a86870c7" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616899c2-50cb-444d-a080-9c132521ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a7883a-d0b6-4257-87e2-f4057010b161', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f6eb66-6b30-4298-b684-12f90732e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-44c16f52-6085-4b80-92ec-a0182f65a6ac-2e22c667-b044-4d82-99d9-4873a86870c7" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Creating volume 2e22c667-b044-4d82-99d9-4873a86870c7 from snapshot 44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-2e22c667-b044-4d82-99d9-4873a86870c7" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Volume volume-20a7883a-d0b6-4257-87e2-f4057010b161 (20a7883a-d0b6-4257-87e2-f4057010b161): created successfully Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f6eb66-6b30-4298-b684-12f90732e884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Flow 'volume_create_manager' (ffd65fb3-c5e7-409d-8355-439ef6c8434d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-2e22c667-b044-4d82-99d9-4873a86870c7" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] snapshot: 44c16f52-6085-4b80-92ec-a0182f65a6ac, volume: 2e22c667-b044-4d82-99d9-4873a86870c7, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:36:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-444af0dc-ad9e-4d83-b72b-df46d89a4e05 tempest-GroupSnapshotsV319Test-433907128 None] Created volume successfully. Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[75928b1d-834c-4650-99f6-0a65cc6565fc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:32 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac Jul 25 02:36:32 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:32 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba310a06-988f-4bbb-a118-e13acf17fbe0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] GroupSnapshot eb30273f-cc3e-4821-adcd-166a86078e1b: creating. Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Group snapshot eb30273f-cc3e-4821-adcd-166a86078e1b: creating. {{(pid=88279) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:32 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:32 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:32 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.412s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:36:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:32 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 Jul 25 02:36:32 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:38 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7" returned: 0 in 5.518s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:38 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd65b5a-8bc5-4285-9b02-32c3ee68379e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:38 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:38 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:38 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.521s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:38 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:36:38 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Converted 1024.00 MB image at 185.55 MB/s Jul 25 02:36:38 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 is being set with open permissions: ugo+rw Jul 25 02:36:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:38 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 Jul 25 02:36:38 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:39 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-2e22c667-b044-4d82-99d9-4873a86870c7" released by "_copy_volume_from_snapshot" :: held 7.173s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-44c16f52-6085-4b80-92ec-a0182f65a6ac-2e22c667-b044-4d82-99d9-4873a86870c7" released by "_create_volume_from_snapshot" :: held 7.222s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.249s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.612s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Creating offline snapshot 5661fbf9-3f81-46c5-b0d0-002433a99e05 of volume 20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42181fb7-c205-4548-a8fe-662e41781e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e22c667-b044-4d82-99d9-4873a86870c7', 'volume_size': 1, 'snapshot_id': '44c16f52-6085-4b80-92ec-a0182f65a6ac'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de7cfb3-86f4-4104-954c-dc6a68c8abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb405f-fb20-4ab3-a0d6-72a7486e0e18]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Volume volume-2e22c667-b044-4d82-99d9-4873a86870c7 (2e22c667-b044-4d82-99d9-4873a86870c7): created successfully Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de7cfb3-86f4-4104-954c-dc6a68c8abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Flow 'volume_create_manager' (96105376-8917-4a6f-888b-a965418ff98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-325453de-9ce7-4f46-a50f-5e8e027d9d2e tempest-VolumesDeleteCascade-599046930 None] Created volume successfully. Jul 25 02:36:39 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 Jul 25 02:36:39 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:39 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:39 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 1G Jul 25 02:36:39 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-c4d7a10a-5549-4aa4-9fe0-f088419e8da4-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-c4d7a10a-5549-4aa4-9fe0-f088419e8da4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Performing cascade delete. {{(pid=88279) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-44c16f52-6085-4b80-92ec-a0182f65a6ac-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-44c16f52-6085-4b80-92ec-a0182f65a6ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-44c16f52-6085-4b80-92ec-a0182f65a6ac" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-44c16f52-6085-4b80-92ec-a0182f65a6ac" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Deleting offline snapshot 44c16f52-6085-4b80-92ec-a0182f65a6ac of volume c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] snapshot_file for this snap is: volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a31b0-e1d3-4335-b5f8-0f56a9fb4a7f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:39 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac Jul 25 02:36:39 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 1G" returned: 0 in 0.502s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a7883a-d0b6-4257-87e2-f4057010b161 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a7883a-d0b6-4257-87e2-f4057010b161 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 Jul 25 02:36:40 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac144f6-fcef-44ed-94d7-cb1a55dbe1e5]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a7883a-d0b6-4257-87e2-f4057010b161 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05" returned: 0 in 0.305s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 Jul 25 02:36:40 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:40 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05" returned: 0 in 0.233s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info Jul 25 02:36:40 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.355s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac Jul 25 02:36:40 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info Jul 25 02:36:40 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:40 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac" returned: 0 in 0.346s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:40 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac Jul 25 02:36:40 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:41 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.info" returned: 0 in 0.248s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6907567e-67a4-4e3c-a1cb-834c5c74e72a tempest-GroupSnapshotsV319Test-433907128 None] group_snapshot eb30273f-cc3e-4821-adcd-166a86078e1b: created successfully Jul 25 02:36:41 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4.44c16f52-6085-4b80-92ec-a0182f65a6ac" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-44c16f52-6085-4b80-92ec-a0182f65a6ac" released by "_delete_snapshot" :: held 1.406s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" released by "delete_snapshot" :: held 1.426s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Created reservations ['d163e760-0666-4376-9e5f-6617ada6057c', 'fc69e9b7-7c28-4103-ab16-d91dc7b8a768', '7c0d77a2-4285-4627-9ccd-bf457faa1a11', '0cd23011-4bf9-4bba-8f46-5d7fe1fa0778'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Delete snapshot completed successfully. Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-44c16f52-6085-4b80-92ec-a0182f65a6ac-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Snapshots deleted, issuing volume delete {{(pid=88279) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" acquired by "delete_volume" :: waited 0.013s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d2af67-71cc-4291-a5d5-79ddfd24b37f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:41 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:41 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:41 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.354s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:41 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4 Jul 25 02:36:41 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:41 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" returned: 0 in 0.238s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-c4d7a10a-5549-4aa4-9fe0-f088419e8da4" released by "delete_volume" :: held 0.646s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Created reservations ['eabc87c1-3938-4bb5-853b-52e8fd9ca199', '0cd28b5d-ccc0-4863-aa03-d3d4cfe42cda', '512ceb9f-5c4c-4300-8c5f-8c48ffe926d1', '72fb5f4a-b315-4c4b-aab0-a8339a14b956'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:42 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:42 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:42 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:42 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Deleted volume successfully. Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-282f8c5f-f1c7-44ae-a959-47359ca926b1 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-c4d7a10a-5549-4aa4-9fe0-f088419e8da4-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:42 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] group_snapshot eb30273f-cc3e-4821-adcd-166a86078e1b: deleting Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] group_snapshot eb30273f-cc3e-4821-adcd-166a86078e1b: deleting {{(pid=88279) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "cinder-quobyte-20a7883a-d0b6-4257-87e2-f4057010b161" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Lock "cinder-quobyte-20a7883a-d0b6-4257-87e2-f4057010b161" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "cinder-quobyte-5661fbf9-3f81-46c5-b0d0-002433a99e05" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Lock "cinder-quobyte-5661fbf9-3f81-46c5-b0d0-002433a99e05" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Deleting offline snapshot 5661fbf9-3f81-46c5-b0d0-002433a99e05 of volume 20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] snapshot_file for this snap is: volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74851a6a-d19f-4c40-a7e4-26aa5efc970e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:42 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 Jul 25 02:36:42 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:42 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05" returned: 0 in 0.365s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a7883a-d0b6-4257-87e2-f4057010b161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4575177d-daa7-4cdf-9d9c-3a7d1be8a268]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-2e22c667-b044-4d82-99d9-4873a86870c7-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-2e22c667-b044-4d82-99d9-4873a86870c7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "cinder-quobyte-2e22c667-b044-4d82-99d9-4873a86870c7" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-2e22c667-b044-4d82-99d9-4873a86870c7" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:43 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 Jul 25 02:36:43 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99c5a3f-24ea-4438-bf8b-ad613ce830dc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:43 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 Jul 25 02:36:43 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:43 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161" returned: 0 in 0.358s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:43 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 Jul 25 02:36:43 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:43 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7" returned: 0 in 0.374s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:43 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7 Jul 25 02:36:43 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:43 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05" returned: 0 in 0.370s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:43 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05 Jul 25 02:36:43 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:43 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2e22c667-b044-4d82-99d9-4873a86870c7" returned: 0 in 0.268s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-quobyte-2e22c667-b044-4d82-99d9-4873a86870c7" released by "delete_volume" :: held 0.693s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Created reservations ['4fb52812-84d5-42be-b78a-a1a5f2e79fdc', 'baeb9889-ee23-418a-81b7-f34d6510beb6', '0f8bb153-9af5-4eff-8742-dd42906d65fc', '0107718f-6df9-4755-8d92-e202462f8f01'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:43 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:43 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:43 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161.5661fbf9-3f81-46c5-b0d0-002433a99e05" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Lock "cinder-quobyte-5661fbf9-3f81-46c5-b0d0-002433a99e05" released by "_delete_snapshot" :: held 1.477s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Lock "cinder-quobyte-20a7883a-d0b6-4257-87e2-f4057010b161" released by "delete_snapshot" :: held 1.500s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:44 devstack cinder-volume[88279]: WARNING cinder.quota [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1854008831 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1854008831, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:36:44 devstack cinder-volume[88279]: WARNING cinder.quota [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1854008831 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1854008831, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] Created reservations ['596f1c3f-245a-4391-b5ab-633e0686e9e9', 'ac14a676-7643-4833-b7f1-44fedaef7554', '0181dd75-6e87-49ad-ae51-8c89fe75f28c', 'd88daab3-2530-46b3-aabc-79bb32e46793'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:44 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.298s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5f5ae8b8-58b5-4b4a-923e-05717ed1fae4 tempest-GroupSnapshotsV319Test-433907128 None] group_snapshot eb30273f-cc3e-4821-adcd-166a86078e1b: deleted successfully Jul 25 02:36:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Deleted volume successfully. Jul 25 02:36:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40222f87-1b86-4562-aa3e-0fd2a7e617b4 tempest-VolumesDeleteCascade-599046930 None] Lock "cinder-2e22c667-b044-4d82-99d9-4873a86870c7-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "cinder-quobyte-20a7883a-d0b6-4257-87e2-f4057010b161" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Lock "cinder-quobyte-20a7883a-d0b6-4257-87e2-f4057010b161" acquired by "delete_volume" :: waited 0.041s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54ded5-9aea-4284-b0c8-642fee36ebea]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:45 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 Jul 25 02:36:45 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Flow 'volume_create_manager' (6dc0972b-d965-414a-aaae-0cdc2e442506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b41ba1-dc2b-42b3-acac-80b7d0c18aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b41ba1-dc2b-42b3-acac-80b7d0c18aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-697468135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff5cf9a-e790-47aa-a3c1-ff059dca3edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1398c53dc2e4ffe860c0eef7c4b7f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:45Z,use_quota=True,user_id='c4cacd9069e04183b7ea1a92a90246b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6acc795-71b1-4c12-bd3f-22f1779a5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6acc795-71b1-4c12-bd3f-22f1779a5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e8fd98-ddbc-40b1-a575-d4958e4d030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e8fd98-ddbc-40b1-a575-d4958e4d030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff5cf9a-e790-47aa-a3c1-ff059dca3edb', 'volume_name': 'volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e45749a-bbec-4185-a3a1-63fa5a4fca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e45749a-bbec-4185-a3a1-63fa5a4fca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746c4fec-59fb-4a76-9e56-69778073ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Volume 5ff5cf9a-e790-47aa-a3c1-ff059dca3edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb', 'volume_size': 1} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-697468135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff5cf9a-e790-47aa-a3c1-ff059dca3edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1398c53dc2e4ffe860c0eef7c4b7f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:45Z,use_quota=True,user_id='c4cacd9069e04183b7ea1a92a90246b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Creating volume 5ff5cf9a-e790-47aa-a3c1-ff059dca3edb {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:45 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:45 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb 1073741824 Jul 25 02:36:45 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:45 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161" returned: 0 in 0.489s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:45 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161 Jul 25 02:36:45 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:46 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb 1073741824" returned: 0 in 0.525s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:46 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-20a7883a-d0b6-4257-87e2-f4057010b161" returned: 0 in 0.298s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Lock "cinder-quobyte-20a7883a-d0b6-4257-87e2-f4057010b161" released by "delete_volume" :: held 0.900s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:46 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb Jul 25 02:36:46 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Created reservations ['3975a7a7-92bc-4631-afe1-3157dd81f2a1'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:46 devstack cinder-volume[88279]: WARNING cinder.quota [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1854008831 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1854008831, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Created reservations ['ea82935b-e8c3-44a1-81f4-e83404235606', 'd19f8d40-27f8-41a2-bc25-0019d917c1b7', 'f44deb5f-03ab-4744-9861-3304b8701005', '003e70c2-76e3-4bc8-8e9c-44f4a0c20959'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:46 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb" returned: 0 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746c4fec-59fb-4a76-9e56-69778073ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:46 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5d29a7-ee01-44dd-b11a-6caa85c73baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:46 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:46 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Volume volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb (5ff5cf9a-e790-47aa-a3c1-ff059dca3edb): created successfully Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5d29a7-ee01-44dd-b11a-6caa85c73baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Flow 'volume_create_manager' (6dc0972b-d965-414a-aaae-0cdc2e442506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-79b004f7-47bb-4642-bdf9-003dde5c7b55 tempest-AttachVolumeTestJSON-1408405032 None] Created volume successfully. Jul 25 02:36:46 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:46 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-05d27237-153a-4e07-b77b-01e6b4cc89b6 tempest-GroupSnapshotsV319Test-433907128 None] Delete group completed successfully. Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Flow 'volume_create_manager' (621ce1a2-f0f3-4635-a792-61dfd389e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70904124-e679-4080-a9b9-dafb7f90e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70904124-e679-4080-a9b9-dafb7f90e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1467591637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62748c0f-d9f5-478a-aca5-4ec92f0fda9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d5593b9e74f879d50e7cd3a1fdd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:48Z,use_quota=True,user_id='5212f556bec6431f83b5ab1a46c581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96436b7-4bb5-40b7-86e4-bfdeb51f2a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96436b7-4bb5-40b7-86e4-bfdeb51f2a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b91f82-2adf-461e-91a1-29c96a10f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b91f82-2adf-461e-91a1-29c96a10f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62748c0f-d9f5-478a-aca5-4ec92f0fda9e', 'volume_name': 'volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570bcc70-202e-410a-a855-aebce576ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570bcc70-202e-410a-a855-aebce576ea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3586d0-7c37-407e-8abb-fe324ca3be7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:48 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Volume 62748c0f-d9f5-478a-aca5-4ec92f0fda9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e', 'volume_size': 1} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1467591637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62748c0f-d9f5-478a-aca5-4ec92f0fda9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d5593b9e74f879d50e7cd3a1fdd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:48Z,use_quota=True,user_id='5212f556bec6431f83b5ab1a46c581f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Creating volume 62748c0f-d9f5-478a-aca5-4ec92f0fda9e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:48 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:48 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e 1073741824 Jul 25 02:36:48 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-398fd8a8-1d0e-4d85-80fc-27310f0eb690 req-c5fdf827-02f4-406a-b0dd-7ecd6f84e91a tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:49 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e 1073741824" returned: 0 in 0.592s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:49 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e Jul 25 02:36:49 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:49 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-398fd8a8-1d0e-4d85-80fc-27310f0eb690 req-c5fdf827-02f4-406a-b0dd-7ecd6f84e91a tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.475s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3586d0-7c37-407e-8abb-fe324ca3be7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4fa2fd-bbe2-44ff-8a9f-1b76f47e85a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-398fd8a8-1d0e-4d85-80fc-27310f0eb690 req-c5fdf827-02f4-406a-b0dd-7ecd6f84e91a tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:49 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Volume volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e (62748c0f-d9f5-478a-aca5-4ec92f0fda9e): created successfully Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4fa2fd-bbe2-44ff-8a9f-1b76f47e85a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Flow 'volume_create_manager' (621ce1a2-f0f3-4635-a792-61dfd389e795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:49 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5540d3df-802b-4788-9f7a-99b4f8b2b301 tempest-VolumesMetadataTest-1984807749 None] Created volume successfully. Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-398fd8a8-1d0e-4d85-80fc-27310f0eb690 req-c5fdf827-02f4-406a-b0dd-7ecd6f84e91a tempest-AttachVolumeTestJSON-1408405032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bce06a33-20b9-4c67-ae78-1d47239de2f6', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:36:49 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-398fd8a8-1d0e-4d85-80fc-27310f0eb690 req-c5fdf827-02f4-406a-b0dd-7ecd6f84e91a tempest-AttachVolumeTestJSON-1408405032 None] attachment_update completed successfully. Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Flow 'volume_create_manager' (87f4d992-ef25-4acb-b990-e63b5b6446e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14b57ee-d7de-4989-8e6e-93f2ad6e852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14b57ee-d7de-4989-8e6e-93f2ad6e852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2049730665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f1db15-4321-41d2-9b14-c0682d5bfee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34960d8d5224556b32520965b1a1f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:50Z,use_quota=True,user_id='7f97c8e592ba4ab2a4df34505f6b8701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf80524a-b279-4a84-ac50-1503a84b8716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf80524a-b279-4a84-ac50-1503a84b8716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcf7482-033b-41f3-bc98-7f7baa283b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcf7482-033b-41f3-bc98-7f7baa283b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f1db15-4321-41d2-9b14-c0682d5bfee1', 'volume_name': 'volume-64f1db15-4321-41d2-9b14-c0682d5bfee1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a01b33-aa5d-4960-9e48-aa39e09150f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a01b33-aa5d-4960-9e48-aa39e09150f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a65ab8a-3a27-40ef-8093-4e6259fc963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:50 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Volume 64f1db15-4321-41d2-9b14-c0682d5bfee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f1db15-4321-41d2-9b14-c0682d5bfee1', 'volume_size': 1} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2049730665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f1db15-4321-41d2-9b14-c0682d5bfee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34960d8d5224556b32520965b1a1f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:50Z,use_quota=True,user_id='7f97c8e592ba4ab2a4df34505f6b8701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Creating volume 64f1db15-4321-41d2-9b14-c0682d5bfee1 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:50 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:50 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 1073741824 Jul 25 02:36:50 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Acquiring lock "cinder-62748c0f-d9f5-478a-aca5-4ec92f0fda9e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Lock "cinder-62748c0f-d9f5-478a-aca5-4ec92f0fda9e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:50 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 1073741824" returned: 0 in 0.691s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:50 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:50 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Acquiring lock "cinder-quobyte-62748c0f-d9f5-478a-aca5-4ec92f0fda9e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:50 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 Jul 25 02:36:50 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Lock "cinder-quobyte-62748c0f-d9f5-478a-aca5-4ec92f0fda9e" acquired by "delete_volume" :: waited 0.063s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6045e1a6-66fd-4031-8251-3fe83d2ab7b6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:51 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e Jul 25 02:36:51 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:51 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 8 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:36:51 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1" returned: 0 in 0.337s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a65ab8a-3a27-40ef-8093-4e6259fc963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f1db15-4321-41d2-9b14-c0682d5bfee1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2396ff9d-dde0-4499-a341-42c8a9fe7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:51 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Volume volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 (64f1db15-4321-41d2-9b14-c0682d5bfee1): created successfully Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2396ff9d-dde0-4499-a341-42c8a9fe7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Flow 'volume_create_manager' (87f4d992-ef25-4acb-b990-e63b5b6446e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:51 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-69feee56-cdf8-4de7-8a21-712107e11326 tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Created volume successfully. Jul 25 02:36:51 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e" returned: 0 in 0.522s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:51 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e Jul 25 02:36:51 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:51 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62748c0f-d9f5-478a-aca5-4ec92f0fda9e" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Lock "cinder-quobyte-62748c0f-d9f5-478a-aca5-4ec92f0fda9e" released by "delete_volume" :: held 0.888s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Created reservations ['2d52b23a-c992-432a-9894-2706a3df2058', 'b2558000-832d-4759-b005-098275712e11', '999571e3-0972-4d4e-851b-18da3c47e974', 'b08193f5-0cf6-40a3-a5b9-9b82be90cc45'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:52 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:36:52 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:52 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:52 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:36:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Deleted volume successfully. Jul 25 02:36:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-174304b8-1380-4776-a83d-45327be30605 tempest-VolumesMetadataTest-1984807749 None] Lock "cinder-62748c0f-d9f5-478a-aca5-4ec92f0fda9e-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:36:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3385ee74-86d2-40fb-9541-657d503a3701 req-e4892d91-2755-4677-9158-f11eeea4a2fe tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3385ee74-86d2-40fb-9541-657d503a3701 req-e4892d91-2755-4677-9158-f11eeea4a2fe tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3385ee74-86d2-40fb-9541-657d503a3701 req-e4892d91-2755-4677-9158-f11eeea4a2fe tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-3385ee74-86d2-40fb-9541-657d503a3701 req-e4892d91-2755-4677-9158-f11eeea4a2fe tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-64f1db15-4321-41d2-9b14-c0682d5bfee1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1e43283-67ea-40c8-b6ae-fc014421e59d', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:36:53 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-3385ee74-86d2-40fb-9541-657d503a3701 req-e4892d91-2755-4677-9158-f11eeea4a2fe tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] attachment_update completed successfully. Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=114,cinder:SELECT=113,cinder:INSERT=26,cinder:DELETE=4 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=112,cinder:UPDATE=115,cinder:DELETE=13,cinder:INSERT=30 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Flow 'volume_create_manager' (ee2df1e6-2d16-4a15-bc7b-ade484b230a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7a241-1f7e-41c6-9033-ac0a2abb4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7a241-1f7e-41c6-9033-ac0a2abb4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2078970880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76ab1d7-28f4-4498-bebc-544c878c1a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7baaae60de40998764df5340c73313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:59Z,use_quota=True,user_id='87224c1e84794581b4c2c2f35ef8a64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d782fce-c8e5-4b1a-927b-a8ab60235b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d782fce-c8e5-4b1a-927b-a8ab60235b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7846cf-09b6-40d6-9b79-aae769e66c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7846cf-09b6-40d6-9b79-aae769e66c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76ab1d7-28f4-4498-bebc-544c878c1a14', 'volume_name': 'volume-c76ab1d7-28f4-4498-bebc-544c878c1a14', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f98e33-2776-470b-aa54-8c8916e604d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f98e33-2776-470b-aa54-8c8916e604d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25e6572-62f8-4f0a-9735-738e4a72caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Volume c76ab1d7-28f4-4498-bebc-544c878c1a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76ab1d7-28f4-4498-bebc-544c878c1a14', 'volume_size': 1} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2078970880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76ab1d7-28f4-4498-bebc-544c878c1a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7baaae60de40998764df5340c73313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:36:59Z,use_quota=True,user_id='87224c1e84794581b4c2c2f35ef8a64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Creating volume c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:36:58 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:36:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:58 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 1073741824 Jul 25 02:36:58 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-824ddf98-e823-4713-ba4a-e30866c1fed1 req-90c6b4c6-e0a1-4f7f-9141-ad83b53d997f tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Terminate volume connection completed successfully. Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-824ddf98-e823-4713-ba4a-e30866c1fed1 req-90c6b4c6-e0a1-4f7f-9141-ad83b53d997f tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Deleting attachment e1e43283-67ea-40c8-b6ae-fc014421e59d. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:36:59 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 1073741824" returned: 0 in 0.777s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:59 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:36:59 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Acquiring lock "cinder-64f1db15-4321-41d2-9b14-c0682d5bfee1-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "cinder-64f1db15-4321-41d2-9b14-c0682d5bfee1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Acquiring lock "cinder-quobyte-64f1db15-4321-41d2-9b14-c0682d5bfee1" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "cinder-quobyte-64f1db15-4321-41d2-9b14-c0682d5bfee1" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e926e-05ef-4733-989e-38a916828e71]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:36:59 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.415s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25e6572-62f8-4f0a-9735-738e4a72caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76ab1d7-28f4-4498-bebc-544c878c1a14', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b17e2d-689d-417d-b953-f91a38ce3d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:36:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Volume volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 (c76ab1d7-28f4-4498-bebc-544c878c1a14): created successfully Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b17e2d-689d-417d-b953-f91a38ce3d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:36:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Flow 'volume_create_manager' (ee2df1e6-2d16-4a15-bc7b-ade484b230a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5b95f539-b6c8-4d5b-a6c1-23d8f70f2923 tempest-VolumesCloneTest-1941040175 None] Created volume successfully. Jul 25 02:37:00 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 Jul 25 02:37:00 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:00 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1" returned: 0 in 0.436s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:00 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1 Jul 25 02:37:00 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:00 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-64f1db15-4321-41d2-9b14-c0682d5bfee1" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "cinder-quobyte-64f1db15-4321-41d2-9b14-c0682d5bfee1" released by "delete_volume" :: held 0.813s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Created reservations ['a68e1f7a-694f-4457-91e2-438c691a3181', 'cd361c6c-6318-4402-ad41-89c50bb41f9a', '0295179f-f84d-40c2-8eb2-ffc38ebede74', '3fdb2e09-7940-411a-8be9-b404d6777015'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:00 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:00 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:01 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Deleted volume successfully. Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a984571a-84f9-4a32-82cc-04a8f48d6d2d tempest-TestServerVolumeAttachScenarioOldVersion-1540713640 None] Lock "cinder-64f1db15-4321-41d2-9b14-c0682d5bfee1-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Flow 'volume_create_manager' (9aed5898-b9f0-46a1-9c95-138158d324f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53455912-6ee7-4473-afb6-7c2a29ac44c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53455912-6ee7-4473-afb6-7c2a29ac44c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-805615161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb49a3c9-d141-486a-b117-255ea448ac0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7baaae60de40998764df5340c73313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c76ab1d7-28f4-4498-bebc-544c878c1a14,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:01Z,use_quota=True,user_id='87224c1e84794581b4c2c2f35ef8a64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3fdb0c-b9ec-4690-87ca-91080ce6b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3fdb0c-b9ec-4690-87ca-91080ce6b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0f6975-5604-4157-8a21-57bef2c5037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0f6975-5604-4157-8a21-57bef2c5037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cb49a3c9-d141-486a-b117-255ea448ac0d', 'volume_name': 'volume-cb49a3c9-d141-486a-b117-255ea448ac0d', 'volume_size': 2, 'source_volid': 'c76ab1d7-28f4-4498-bebc-544c878c1a14', 'source_volstatus': 'available'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf2c80a-a78c-40e4-8059-5aef8c011f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf2c80a-a78c-40e4-8059-5aef8c011f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3c3135-68d3-4673-8ce6-7561911b66ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Volume cb49a3c9-d141-486a-b117-255ea448ac0d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cb49a3c9-d141-486a-b117-255ea448ac0d', 'volume_size': 2, 'source_volid': 'c76ab1d7-28f4-4498-bebc-544c878c1a14', 'source_volstatus': 'available'} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:01 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Cloning volume c76ab1d7-28f4-4498-bebc-544c878c1a14 to volume cb49a3c9-d141-486a-b117-255ea448ac0d Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Creating offline snapshot a4787140-4511-4c7a-811a-8a7fcf478e84 of volume c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe5141-101d-4729-b078-5b65d8f244c2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ffd07328-41b2-484b-93ec-5c10a4b41a02 tempest-GroupsTest-2137503961 None] Group tempest-Group1-1585838350: creating Jul 25 02:37:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ffd07328-41b2-484b-93ec-5c10a4b41a02 tempest-GroupsTest-2137503961 None] Group tempest-Group1-1585838350: created successfully Jul 25 02:37:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ffd07328-41b2-484b-93ec-5c10a4b41a02 tempest-GroupsTest-2137503961 None] Create group completed successfully. Jul 25 02:37:02 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:37:02 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:02 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.699s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:02 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 1G Jul 25 02:37:02 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-36957235-60c9-4246-92fa-424e6ee7f90e tempest-GroupsTest-2137503961 None] Group tempest-Group2-1876355484: creating Jul 25 02:37:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-36957235-60c9-4246-92fa-424e6ee7f90e tempest-GroupsTest-2137503961 None] Group tempest-Group2-1876355484: created successfully Jul 25 02:37:03 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-36957235-60c9-4246-92fa-424e6ee7f90e tempest-GroupsTest-2137503961 None] Create group completed successfully. Jul 25 02:37:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 1G" returned: 0 in 0.836s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:03 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 Jul 25 02:37:03 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:03 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84" returned: 0 in 0.448s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:03 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 is being set with open permissions: ugo+rw Jul 25 02:37:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:03 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 Jul 25 02:37:03 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:04 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84" returned: 0 in 0.276s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:04 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info Jul 25 02:37:04 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:04 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info" returned: 0 in 0.325s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:04 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info is being set with open permissions: ugo+rw Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:04 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info Jul 25 02:37:04 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:04 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.info" returned: 0 in 0.330s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Acquiring lock "cinder-quobyte-cb49a3c9-d141-486a-b117-255ea448ac0d" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-cb49a3c9-d141-486a-b117-255ea448ac0d" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] snapshot: a4787140-4511-4c7a-811a-8a7fcf478e84, volume: cb49a3c9-d141-486a-b117-255ea448ac0d, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a88a0-ead5-4b5d-87e5-fb8dfeb3677d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:05 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 Jul 25 02:37:05 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Flow 'volume_create_manager' (dde19d15-f28a-41fb-a2b5-9012cc9eb151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0482e0e2-c2cb-44ad-8a1a-a9fbe812e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0482e0e2-c2cb-44ad-8a1a-a9fbe812e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-68158387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f238e8f-7f8a-4c32-a5bf-99a9adb461a8,host='devstack@QuobyteHD#QuobyteHD',id=14dc5a35-97aa-4737-9a56-e78fc90e617e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04da3e670f034d2490245d0154861899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:05Z,use_quota=True,user_id='74fec316521f48c28d4f544e7305e6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9133d79b-ba85-413e-9949-70997dfed238),volume_type_id=9133d79b-ba85-413e-9949-70997dfed238)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712ca048-7be9-4c3d-82d2-f3f3be278dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712ca048-7be9-4c3d-82d2-f3f3be278dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc9e20b-26ec-4833-9420-cab647924936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc9e20b-26ec-4833-9420-cab647924936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14dc5a35-97aa-4737-9a56-e78fc90e617e', 'volume_name': 'volume-14dc5a35-97aa-4737-9a56-e78fc90e617e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aabb93-9b12-41da-99ec-6e28c05d32f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aabb93-9b12-41da-99ec-6e28c05d32f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714273f6-e526-42b1-9c5a-d92c0b83bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:05 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Volume 14dc5a35-97aa-4737-9a56-e78fc90e617e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14dc5a35-97aa-4737-9a56-e78fc90e617e', 'volume_size': 1} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:05 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84" returned: 0 in 0.543s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76ab1d7-28f4-4498-bebc-544c878c1a14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d581623b-2251-4880-babe-a4d5e329e0ff]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:05 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:37:05 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:05 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:37:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:05 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d Jul 25 02:37:05 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:11 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d" returned: 0 in 5.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0040f8-59f0-4dd2-bac0-b64ceef7be12]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:11 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:37:11 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:11 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.591s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:11 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:37:11 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Converted 1024.00 MB image at 193.62 MB/s Jul 25 02:37:11 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d is being set with open permissions: ugo+rw Jul 25 02:37:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:11 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d Jul 25 02:37:11 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:12 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d" returned: 0 in 0.413s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-cb49a3c9-d141-486a-b117-255ea448ac0d" released by "_copy_volume_from_snapshot" :: held 7.341s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Acquiring lock "cinder-quobyte-a4787140-4511-4c7a-811a-8a7fcf478e84" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-a4787140-4511-4c7a-811a-8a7fcf478e84" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Deleting offline snapshot a4787140-4511-4c7a-811a-8a7fcf478e84 of volume c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] snapshot_file for this snap is: volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ded0b2-2663-4d6a-a8a0-674a6c7d2860]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:12 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 Jul 25 02:37:12 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:12 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84" returned: 0 in 0.477s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76ab1d7-28f4-4498-bebc-544c878c1a14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6c364b-eac1-4aa1-b545-9dd6aa7718cf]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:12 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:37:12 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:13 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.469s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:13 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 Jul 25 02:37:13 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:13 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84" returned: 0 in 0.452s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:13 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84 Jul 25 02:37:13 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:13 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14.a4787140-4511-4c7a-811a-8a7fcf478e84" returned: 0 in 0.288s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-a4787140-4511-4c7a-811a-8a7fcf478e84" released by "_delete_snapshot" :: held 1.802s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.356s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.676s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f238e8f-7f8a-4c32-a5bf-99a9adb461a8,created_at=2026-07-25T00:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-68158387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f238e8f-7f8a-4c32-a5bf-99a9adb461a8,host='devstack@QuobyteHD#QuobyteHD',id=14dc5a35-97aa-4737-9a56-e78fc90e617e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04da3e670f034d2490245d0154861899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:05Z,use_quota=True,user_id='74fec316521f48c28d4f544e7305e6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9133d79b-ba85-413e-9949-70997dfed238),volume_type_id=9133d79b-ba85-413e-9949-70997dfed238)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Creating volume 14dc5a35-97aa-4737-9a56-e78fc90e617e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:14 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:14 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e 1073741824 Jul 25 02:37:14 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3c3135-68d3-4673-8ce6-7561911b66ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb49a3c9-d141-486a-b117-255ea448ac0d', 'volume_size': 2, 'source_volid': 'c76ab1d7-28f4-4498-bebc-544c878c1a14', 'source_volstatus': 'available'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd00afc-6bc5-450c-8c21-dc456404d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:14 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Volume volume-cb49a3c9-d141-486a-b117-255ea448ac0d (cb49a3c9-d141-486a-b117-255ea448ac0d): created successfully Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd00afc-6bc5-450c-8c21-dc456404d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Flow 'volume_create_manager' (9aed5898-b9f0-46a1-9c95-138158d324f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6e66783a-10a3-4ed8-a508-19b42fa0658d tempest-VolumesCloneTest-1941040175 None] Created volume successfully. Jul 25 02:37:14 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e 1073741824" returned: 0 in 0.446s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:14 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e Jul 25 02:37:14 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "cinder-cb49a3c9-d141-486a-b117-255ea448ac0d-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-cb49a3c9-d141-486a-b117-255ea448ac0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:14 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e" returned: 0 in 0.354s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714273f6-e526-42b1-9c5a-d92c0b83bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14dc5a35-97aa-4737-9a56-e78fc90e617e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3620e9-2c8b-4568-8bc8-41d597dc31ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "cinder-quobyte-cb49a3c9-d141-486a-b117-255ea448ac0d" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:14 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Volume volume-14dc5a35-97aa-4737-9a56-e78fc90e617e (14dc5a35-97aa-4737-9a56-e78fc90e617e): created successfully Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3620e9-2c8b-4568-8bc8-41d597dc31ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Flow 'volume_create_manager' (dde19d15-f28a-41fb-a2b5-9012cc9eb151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-cb49a3c9-d141-486a-b117-255ea448ac0d" acquired by "delete_volume" :: waited 0.036s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e34a4f62-ee5d-49ec-bba8-824cbe69907c tempest-GroupsTest-2137503961 None] Created volume successfully. Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed2c7e-7fd7-4794-affe-3ab679a913a2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:15 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d Jul 25 02:37:15 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:15 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:15 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d Jul 25 02:37:15 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:15 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb49a3c9-d141-486a-b117-255ea448ac0d" returned: 0 in 0.270s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-cb49a3c9-d141-486a-b117-255ea448ac0d" released by "delete_volume" :: held 0.702s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Created reservations ['e55675cb-9e2e-4cc7-8660-b938312bd760', 'c48b48d6-246e-4453-9dd1-be7c3a34f33b', 'e0eb4d92-c8f6-44ef-bfd9-62e5eca08b76', '61ce2335-7c53-4e4e-8177-761efbea0d7f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:15 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:15 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "cinder-c76ab1d7-28f4-4498-bebc-544c878c1a14-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-c76ab1d7-28f4-4498-bebc-544c878c1a14-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:16 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.387s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Deleted volume successfully. Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "cinder-quobyte-c76ab1d7-28f4-4498-bebc-544c878c1a14" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b595926d-2ea4-4daa-95dd-5e9dc1ecd821 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-cb49a3c9-d141-486a-b117-255ea448ac0d-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-c76ab1d7-28f4-4498-bebc-544c878c1a14" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa401c88-f0be-4fab-9db2-1c2d2f1195de]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:16 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:37:16 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Acquiring lock "cinder-quobyte-14dc5a35-97aa-4737-9a56-e78fc90e617e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Lock "cinder-quobyte-14dc5a35-97aa-4737-9a56-e78fc90e617e" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce9b51-1ad4-46df-8ede-247142adc12d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:16 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.439s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:16 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e Jul 25 02:37:16 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:16 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14 Jul 25 02:37:16 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:17 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c76ab1d7-28f4-4498-bebc-544c878c1a14" returned: 0 in 0.321s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-quobyte-c76ab1d7-28f4-4498-bebc-544c878c1a14" released by "delete_volume" :: held 0.849s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:17 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e" returned: 0 in 0.494s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:17 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e Jul 25 02:37:17 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Created reservations ['28594e27-1df5-4a36-b1eb-b7f6aff13018', '4538e0f3-06bc-4000-b802-36edfcdfc0a4', 'afaac7d3-7696-4674-bee3-e469d067427d', '52b2acc8-40f1-4969-9117-ef4101e8b3bd'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:17 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:17 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:17 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-14dc5a35-97aa-4737-9a56-e78fc90e617e" returned: 0 in 0.344s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Lock "cinder-quobyte-14dc5a35-97aa-4737-9a56-e78fc90e617e" released by "delete_volume" :: held 0.894s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Created reservations ['9bc797d6-d22d-45e1-a36a-00f74e628034'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:17 devstack cinder-volume[88279]: WARNING cinder.quota [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-958247748 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-958247748, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:37:17 devstack cinder-volume[88279]: WARNING cinder.quota [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-958247748 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-958247748, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:37:17 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.306s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Deleted volume successfully. Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Created reservations ['8103c058-d852-44a1-9e0e-9092054ebf46', '05458e37-5e42-4d2f-82e1-03ea64f32679', '41e01d95-13c4-430e-8961-db10fbf9488d', '4414214f-3d16-4b1a-8f6b-ef07be19edb9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0cf9b64-bb45-45ac-b700-2ac5dea2f8d3 tempest-VolumesCloneTest-1941040175 None] Lock "cinder-c76ab1d7-28f4-4498-bebc-544c878c1a14-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:17 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:17 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Created reservations ['81ad8a5f-f640-4def-a7f7-642b5771650f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:18 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.358s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:18 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:18 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ef2d8c07-154b-4f16-bb5d-ca53fe5db646 tempest-GroupsTest-2137503961 None] Delete group completed successfully. Jul 25 02:37:18 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:18 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-62b33dbc-7ce1-49ca-bbfd-6891ee0c42d1 tempest-GroupsTest-2137503961 None] Delete group completed successfully. Jul 25 02:37:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-aaba0ba7-137a-4427-a1c6-4edf2dbd309a tempest-GroupsTest-2137503961 None] Group tempest-GroupsTest-Group-812856078: creating Jul 25 02:37:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-aaba0ba7-137a-4427-a1c6-4edf2dbd309a tempest-GroupsTest-2137503961 None] Group tempest-GroupsTest-Group-812856078: created successfully Jul 25 02:37:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-aaba0ba7-137a-4427-a1c6-4edf2dbd309a tempest-GroupsTest-2137503961 None] Create group completed successfully. Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Flow 'volume_create_manager' (982c79b5-1a07-45ca-963a-b400ca161550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c9d982-231c-4ab9-b50d-9928d21697d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c9d982-231c-4ab9-b50d-9928d21697d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710933712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5e7f248-d9f4-48a9-a053-4994326e1da8,host='devstack@QuobyteHD#QuobyteHD',id=67c587b2-a762-438b-9e9d-9233dec8e060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04da3e670f034d2490245d0154861899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:21Z,use_quota=True,user_id='74fec316521f48c28d4f544e7305e6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf25980-bbc0-4b84-a69e-23aca5417f29),volume_type_id=4cf25980-bbc0-4b84-a69e-23aca5417f29)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d88593-99ab-4ab4-86d7-a52ab782b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d88593-99ab-4ab4-86d7-a52ab782b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a86d559-c19a-4d74-ad45-fa919f741307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a86d559-c19a-4d74-ad45-fa919f741307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c587b2-a762-438b-9e9d-9233dec8e060', 'volume_name': 'volume-67c587b2-a762-438b-9e9d-9233dec8e060', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d1c217-be0c-4cc8-8b6f-bb9599cda859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d1c217-be0c-4cc8-8b6f-bb9599cda859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c38c159-54cd-4fbf-8d14-5b594be4c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Volume 67c587b2-a762-438b-9e9d-9233dec8e060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c587b2-a762-438b-9e9d-9233dec8e060', 'volume_size': 1} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5e7f248-d9f4-48a9-a053-4994326e1da8,created_at=2026-07-25T00:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710933712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5e7f248-d9f4-48a9-a053-4994326e1da8,host='devstack@QuobyteHD#QuobyteHD',id=67c587b2-a762-438b-9e9d-9233dec8e060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04da3e670f034d2490245d0154861899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:21Z,use_quota=True,user_id='74fec316521f48c28d4f544e7305e6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf25980-bbc0-4b84-a69e-23aca5417f29),volume_type_id=4cf25980-bbc0-4b84-a69e-23aca5417f29)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Creating volume 67c587b2-a762-438b-9e9d-9233dec8e060 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:21 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 1073741824 Jul 25 02:37:21 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:22 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 1073741824" returned: 0 in 0.650s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:22 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 Jul 25 02:37:22 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:22 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c38c159-54cd-4fbf-8d14-5b594be4c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c587b2-a762-438b-9e9d-9233dec8e060', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00a91cd-06f3-490c-885e-00f3d46f46bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Volume volume-67c587b2-a762-438b-9e9d-9233dec8e060 (67c587b2-a762-438b-9e9d-9233dec8e060): created successfully Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00a91cd-06f3-490c-885e-00f3d46f46bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Flow 'volume_create_manager' (982c79b5-1a07-45ca-963a-b400ca161550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-de2454fb-09e8-47bc-993b-da8c035b85d0 tempest-GroupsTest-2137503961 None] Created volume successfully. Jul 25 02:37:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-6336ab30-4081-41a4-969b-4b6ce8282819 req-49c23644-0bc7-4bfe-89f9-401b3fc853ba tempest-AttachVolumeTestJSON-1408405032 None] Terminate volume connection completed successfully. Jul 25 02:37:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-6336ab30-4081-41a4-969b-4b6ce8282819 req-49c23644-0bc7-4bfe-89f9-401b3fc853ba tempest-AttachVolumeTestJSON-1408405032 None] Deleting attachment bce06a33-20b9-4c67-ae78-1d47239de2f6. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Flow 'volume_create_manager' (04f9c3f1-30c6-482e-879d-9a95ee277374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775227ed-c1e7-45d9-8934-4f2dc34a426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775227ed-c1e7-45d9-8934-4f2dc34a426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078430593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5e7f248-d9f4-48a9-a053-4994326e1da8,host='devstack@QuobyteHD#QuobyteHD',id=1c56eaf5-41ea-44da-aa2b-fd67c29496ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04da3e670f034d2490245d0154861899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:25Z,use_quota=True,user_id='74fec316521f48c28d4f544e7305e6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf25980-bbc0-4b84-a69e-23aca5417f29),volume_type_id=4cf25980-bbc0-4b84-a69e-23aca5417f29)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b31e93d-8f4e-46e0-93bf-77c934eaf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b31e93d-8f4e-46e0-93bf-77c934eaf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fec0c3-0a3b-4cb6-8394-417606beef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fec0c3-0a3b-4cb6-8394-417606beef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c56eaf5-41ea-44da-aa2b-fd67c29496ce', 'volume_name': 'volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba1b2df-99fc-4bc3-b562-c06533f6a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba1b2df-99fc-4bc3-b562-c06533f6a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdaeea0-b1d2-4768-9271-0a8154bdcc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:24 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Volume 1c56eaf5-41ea-44da-aa2b-fd67c29496ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce', 'volume_size': 1} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5e7f248-d9f4-48a9-a053-4994326e1da8,created_at=2026-07-25T00:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078430593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5e7f248-d9f4-48a9-a053-4994326e1da8,host='devstack@QuobyteHD#QuobyteHD',id=1c56eaf5-41ea-44da-aa2b-fd67c29496ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04da3e670f034d2490245d0154861899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:25Z,use_quota=True,user_id='74fec316521f48c28d4f544e7305e6d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf25980-bbc0-4b84-a69e-23aca5417f29),volume_type_id=4cf25980-bbc0-4b84-a69e-23aca5417f29)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Creating volume 1c56eaf5-41ea-44da-aa2b-fd67c29496ce {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:24 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:24 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce 1073741824 Jul 25 02:37:24 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:25 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce 1073741824" returned: 0 in 0.534s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:25 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce Jul 25 02:37:25 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:25 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce" returned: 0 in 0.340s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdaeea0-b1d2-4768-9271-0a8154bdcc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9519d01-3a94-4682-ae92-70b9c5f3bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:25 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Volume volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce (1c56eaf5-41ea-44da-aa2b-fd67c29496ce): created successfully Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9519d01-3a94-4682-ae92-70b9c5f3bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Flow 'volume_create_manager' (04f9c3f1-30c6-482e-879d-9a95ee277374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5e41d103-a782-47b6-92d6-b2855f80e8b8 tempest-GroupsTest-2137503961 None] Created volume successfully. Jul 25 02:37:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-43ff271f-6ac0-4ce3-8c3e-d36686a4d82f tempest-GroupsTest-2137503961 None] Update group completed successfully. Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Flow 'volume_create_manager' (eca044d2-7499-4e26-8441-3c9e344451e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596c21f1-efb4-4e4f-8347-292e46a4b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596c21f1-efb4-4e4f-8347-292e46a4b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2f7624-e9e1-4145-9233-040b28de6c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ae9bc813e547a1b90ed9672da3666f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:27Z,use_quota=True,user_id='e835dc636fa943928f115e02a48d5815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d48df2a-a6c4-4de1-a48d-815fe07dd6bb),volume_type_id=1d48df2a-a6c4-4de1-a48d-815fe07dd6bb)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213591c0-882f-47cb-937c-8dc7636f73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213591c0-882f-47cb-937c-8dc7636f73a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca5d900-eb69-4d81-807f-6fca12833b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:26 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca5d900-eb69-4d81-807f-6fca12833b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb2f7624-e9e1-4145-9233-040b28de6c5d', 'volume_name': 'volume-cb2f7624-e9e1-4145-9233-040b28de6c5d', 'volume_size': 1, 'image_id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765d79de-0ac2-47d5-9231-f91b45e8eec7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99c50c0e4a45906d416ca96ebe0a4d3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0ae9bc813e547a1b90ed9672da3666f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ada59b00fc165cc90e567af48c62558c4ff1fe168d48f8f511826270064614d4ffa51471c8ab94f0c8209202732e7a4f62608ee72f427adfeaef2f7b1ac9772', 'id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'created_at': datetime.datetime(2026, 7, 25, 0, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 37, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765d79de-0ac2-47d5-9231-f91b45e8eec7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd5a3b5-49fc-4ba1-9843-e254f672c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd5a3b5-49fc-4ba1-9843-e254f672c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecca49b-1458-480e-ac9a-114cab943625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Volume cb2f7624-e9e1-4145-9233-040b28de6c5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb2f7624-e9e1-4145-9233-040b28de6c5d', 'volume_size': 1, 'image_id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765d79de-0ac2-47d5-9231-f91b45e8eec7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99c50c0e4a45906d416ca96ebe0a4d3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0ae9bc813e547a1b90ed9672da3666f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ada59b00fc165cc90e567af48c62558c4ff1fe168d48f8f511826270064614d4ffa51471c8ab94f0c8209202732e7a4f62608ee72f427adfeaef2f7b1ac9772', 'id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'created_at': datetime.datetime(2026, 7, 25, 0, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 37, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765d79de-0ac2-47d5-9231-f91b45e8eec7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Trying to clone cb2f7624-e9e1-4145-9233-040b28de6c5d from image 765d79de-0ac2-47d5-9231-f91b45e8eec7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/765d79de-0ac2-47d5-9231-f91b45e8eec7', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:37:27 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Image download 0.00 MB at 0.00 MB/s Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a6b0d-87bc-46fd-af50-7a5b1f351508]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:27 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD Jul 25 02:37:27 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:27 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:28 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD Jul 25 02:37:28 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:28 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f4c8f80e-5f24-4405-945f-6c28ea8d26e9 tempest-GroupsTest-2137503961 None] Update group completed successfully. Jul 25 02:37:28 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD" returned: 1 in 0.545s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:37:28 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Temporary image 765d79de-0ac2-47d5-9231-f91b45e8eec7 is fetched for user e835dc636fa943928f115e02a48d5815. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:37:28 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d0cfa-f594-42c0-9e3e-f8a5a055a92a]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:28 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD Jul 25 02:37:28 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:29 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:29 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD Jul 25 02:37:29 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:29 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD" returned: 1 in 0.647s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2f7624-e9e1-4145-9233-040b28de6c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ae9bc813e547a1b90ed9672da3666f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:27Z,use_quota=True,user_id='e835dc636fa943928f115e02a48d5815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d48df2a-a6c4-4de1-a48d-815fe07dd6bb),volume_type_id=1d48df2a-a6c4-4de1-a48d-815fe07dd6bb)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Creating volume cb2f7624-e9e1-4145-9233-040b28de6c5d {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:30 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:30 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d 1073741824 Jul 25 02:37:30 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Acquiring lock "cinder-quobyte-1c56eaf5-41ea-44da-aa2b-fd67c29496ce" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Lock "cinder-quobyte-1c56eaf5-41ea-44da-aa2b-fd67c29496ce" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c07c27-e589-4814-9164-ace97092492f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:30 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce Jul 25 02:37:30 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:30 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d 1073741824" returned: 0 in 0.991s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:31 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d Jul 25 02:37:31 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:31 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d" returned: 0 in 0.443s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:31 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce" returned: 0 in 0.955s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Attempting download of 765d79de-0ac2-47d5-9231-f91b45e8eec7 ((None, [{'url': 'file:///opt/stack/data/glance/images/765d79de-0ac2-47d5-9231-f91b45e8eec7', 'metadata': {}}])) to volume cb2f7624-e9e1-4145-9233-040b28de6c5d. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:37:31 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce Jul 25 02:37:31 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[79be30d2-0043-4f63-9a9a-b7aa637aee1f]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:32 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0 Jul 25 02:37:32 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:32 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c56eaf5-41ea-44da-aa2b-fd67c29496ce" returned: 0 in 0.640s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Lock "cinder-quobyte-1c56eaf5-41ea-44da-aa2b-fd67c29496ce" released by "delete_volume" :: held 1.715s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Acquiring lock "cinder-quobyte-67c587b2-a762-438b-9e9d-9233dec8e060" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Lock "cinder-quobyte-67c587b2-a762-438b-9e9d-9233dec8e060" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a52136-0a78-4e44-99ee-bead7d9180db]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:32 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0" returned: 0 in 0.701s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:32 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0 Jul 25 02:37:32 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:32 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 Jul 25 02:37:32 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:32 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0" returned: 1 in 0.419s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765d79de-0ac2-47d5-9231-f91b45e8eec7_2cq78xl0' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce2357-5377-4cba-8395-a57a56bc27e3]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:33 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD Jul 25 02:37:33 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:33 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060" returned: 0 in 0.941s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:33 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060 Jul 25 02:37:33 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:33 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD" returned: 0 in 0.662s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:33 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD Jul 25 02:37:33 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:33 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67c587b2-a762-438b-9e9d-9233dec8e060" returned: 0 in 0.444s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Lock "cinder-quobyte-67c587b2-a762-438b-9e9d-9233dec8e060" released by "delete_volume" :: held 1.474s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Created reservations ['00f07c3a-27d9-4b8b-9eb4-233aa7a4ca39'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:34 devstack cinder-volume[88279]: WARNING cinder.quota [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1022216497 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1022216497, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:37:34 devstack cinder-volume[88279]: WARNING cinder.quota [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1022216497 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1022216497, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:37:34 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] 765d79de-0ac2-47d5-9231-f91b45e8eec7 was raw, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Created reservations ['b80150ec-8e54-47c8-83c5-1d28a47abe6d', 'eba1751b-a95a-4522-b590-70741fecbdf8', '688d9200-99fd-4256-b23b-bedf4fcfa10a', '41ac73a6-74ee-4701-b45f-21f046b5594b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:34 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d Jul 25 02:37:34 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (356cce3f-91ba-470d-9c1b-5c4687f0c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765d64ca-7b72-4465-8a1d-44b5d4db5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765d64ca-7b72-4465-8a1d-44b5d4db5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1066221486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52fa42f-7069-49b6-94df-ed0a719ce9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:34Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab6b331-1bd6-4e4a-bb64-64d39451bdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab6b331-1bd6-4e4a-bb64-64d39451bdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940586bf-8584-4f58-8647-1634dad66205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940586bf-8584-4f58-8647-1634dad66205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52fa42f-7069-49b6-94df-ed0a719ce9e5', 'volume_name': 'volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bfd85c-9e7f-4635-95ba-3d1a69967e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bfd85c-9e7f-4635-95ba-3d1a69967e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ba1d0e-1a37-4002-97bb-a38e227efd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:34 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Volume c52fa42f-7069-49b6-94df-ed0a719ce9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5', 'volume_size': 1} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1066221486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52fa42f-7069-49b6-94df-ed0a719ce9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:34Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Creating volume c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:34 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:34 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 1073741824 Jul 25 02:37:34 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Created reservations ['8e7c4bf2-7141-416b-80ee-303f0d522a7f', '178d61dc-1330-4cf9-97ca-8eeff326ea9c', '1e038dbe-6951-429b-a9f4-45243d87df84', '9a2b914e-3184-409d-9d33-1e83863b9118'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:34 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:34 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:34 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d" returned: 0 in 0.639s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_765d79de-0ac2-47d5-9231-f91b45e8eec7_h9lvtmvpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:37:34 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Converted 0.00 MB image at 0.00 MB/s Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:34 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d 1G Jul 25 02:37:34 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:34 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.339s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c993fc1c-300d-4df1-bdbd-f5ecaebfca8e tempest-GroupsTest-2137503961 None] Delete group completed successfully. Jul 25 02:37:34 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 1073741824" returned: 0 in 0.558s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:34 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 Jul 25 02:37:34 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:35 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:35 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d 1G" returned: 0 in 0.467s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Downloaded image 765d79de-0ac2-47d5-9231-f91b45e8eec7 ((None, [{'url': 'file:///opt/stack/data/glance/images/765d79de-0ac2-47d5-9231-f91b45e8eec7', 'metadata': {}}])) to volume cb2f7624-e9e1-4145-9233-040b28de6c5d successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Temporary image 765d79de-0ac2-47d5-9231-f91b45e8eec7 for user e835dc636fa943928f115e02a48d5815 is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Marking volume cb2f7624-e9e1-4145-9233-040b28de6c5d as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ba1d0e-1a37-4002-97bb-a38e227efd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5872163-a64f-41e6-9c08-a387ed6c95f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Copying metadata from image 765d79de-0ac2-47d5-9231-f91b45e8eec7 to cb2f7624-e9e1-4145-9233-040b28de6c5d. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Creating volume glance metadata for volume cb2f7624-e9e1-4145-9233-040b28de6c5d backed by image 765d79de-0ac2-47d5-9231-f91b45e8eec7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '99c50c0e4a45906d416ca96ebe0a4d3f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:37:35 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Volume volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 (c52fa42f-7069-49b6-94df-ed0a719ce9e5): created successfully Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5872163-a64f-41e6-9c08-a387ed6c95f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (356cce3f-91ba-470d-9c1b-5c4687f0c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:35 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8c4905e5-45a1-4d8b-b876-e95aad28d20a tempest-VolumesSnapshotTestJSON-986118049 None] Created volume successfully. Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecca49b-1458-480e-ac9a-114cab943625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2f7624-e9e1-4145-9233-040b28de6c5d', 'volume_size': 1, 'image_id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765d79de-0ac2-47d5-9231-f91b45e8eec7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99c50c0e4a45906d416ca96ebe0a4d3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0ae9bc813e547a1b90ed9672da3666f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ada59b00fc165cc90e567af48c62558c4ff1fe168d48f8f511826270064614d4ffa51471c8ab94f0c8209202732e7a4f62608ee72f427adfeaef2f7b1ac9772', 'id': '765d79de-0ac2-47d5-9231-f91b45e8eec7', 'created_at': datetime.datetime(2026, 7, 25, 0, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 37, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765d79de-0ac2-47d5-9231-f91b45e8eec7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc62a7f2-fd8c-49fa-b4d5-494df05079ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:35 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Volume volume-cb2f7624-e9e1-4145-9233-040b28de6c5d (cb2f7624-e9e1-4145-9233-040b28de6c5d): created successfully Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc62a7f2-fd8c-49fa-b4d5-494df05079ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Flow 'volume_create_manager' (eca044d2-7499-4e26-8441-3c9e344451e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:35 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-abd9eac7-cfbd-4c22-ab48-b19964c3307d tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Created volume successfully. Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Acquiring lock "cinder-cb2f7624-e9e1-4145-9233-040b28de6c5d-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "cinder-cb2f7624-e9e1-4145-9233-040b28de6c5d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Acquiring lock "cinder-quobyte-cb2f7624-e9e1-4145-9233-040b28de6c5d" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Creating offline snapshot 4cf96f42-6231-4c81-8726-a54139da70ea of volume c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "cinder-quobyte-cb2f7624-e9e1-4145-9233-040b28de6c5d" acquired by "delete_volume" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33bfa88-165e-4785-9aa9-ab3d13fe3e43]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1578342-f315-4325-8d59-dda4889c1712]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:36 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d Jul 25 02:37:36 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:36 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 Jul 25 02:37:36 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:37 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d" returned: 0 in 0.513s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:37 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d Jul 25 02:37:37 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:37 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5" returned: 0 in 0.601s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:37 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea 1G Jul 25 02:37:37 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:37 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb2f7624-e9e1-4145-9233-040b28de6c5d" returned: 0 in 0.339s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "cinder-quobyte-cb2f7624-e9e1-4145-9233-040b28de6c5d" released by "delete_volume" :: held 0.919s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:37 devstack cinder-volume[88279]: WARNING cinder.quota [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:37:37 devstack cinder-volume[88279]: WARNING cinder.quota [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Created reservations ['987cb3b2-752a-419e-b163-e75284948859', 'cdc23459-8182-41f9-81f3-723d8f2995cc', 'e4e1bdcf-57e8-4207-8844-ac1799801db2', 'd2c22f47-ae09-4db5-a180-34185d1a29fc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:37 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:37 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:37 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea 1G" returned: 0 in 0.583s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:37 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea Jul 25 02:37:37 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:38 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Deleted volume successfully. Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9ff80db1-2760-4588-bef1-f8f3b87c7e13 tempest-VolumeAndVolumeTypeFromImageTest-319428485 None] Lock "cinder-cb2f7624-e9e1-4145-9233-040b28de6c5d-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:38 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea" returned: 0 in 0.437s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:38 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea is being set with open permissions: ugo+rw Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:38 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea Jul 25 02:37:38 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:38 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:38 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info Jul 25 02:37:38 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:38 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info" returned: 0 in 0.328s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:38 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info is being set with open permissions: ugo+rw Jul 25 02:37:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:39 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info Jul 25 02:37:39 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:39 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.info" returned: 0 in 0.366s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8c66a345-4643-4133-a280-c22d9430f6e2 tempest-VolumesSnapshotTestJSON-986118049 None] Create snapshot completed successfully Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-4cf96f42-6231-4c81-8726-a54139da70ea-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-4cf96f42-6231-4c81-8726-a54139da70ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-c52fa42f-7069-49b6-94df-ed0a719ce9e5" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-c52fa42f-7069-49b6-94df-ed0a719ce9e5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-4cf96f42-6231-4c81-8726-a54139da70ea" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-4cf96f42-6231-4c81-8726-a54139da70ea" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Deleting offline snapshot 4cf96f42-6231-4c81-8726-a54139da70ea of volume c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] snapshot_file for this snap is: volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9053f6-007e-4e70-b85d-5886045b3598]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:40 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea Jul 25 02:37:40 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:40 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea" returned: 0 in 0.541s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6cd58-6f6c-46e9-8d6c-cb46d21843b6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:41 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 Jul 25 02:37:41 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:41 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5" returned: 0 in 0.570s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:41 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea Jul 25 02:37:41 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:42 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea" returned: 0 in 0.541s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:42 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea Jul 25 02:37:42 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:42 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5.4cf96f42-6231-4c81-8726-a54139da70ea" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-4cf96f42-6231-4c81-8726-a54139da70ea" released by "_delete_snapshot" :: held 2.213s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-c52fa42f-7069-49b6-94df-ed0a719ce9e5" released by "delete_snapshot" :: held 2.253s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['aeb5a65b-4007-4038-abe8-f9ffa2f7d66d', 'fd5466f2-ab79-45ac-9792-8c04ed07d4b9', '2f00ab4a-3252-4261-b34b-18ffa27f16c4', 'e2315e74-7418-404d-bc9a-5998694fe9f2'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:42 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Delete snapshot completed successfully. Jul 25 02:37:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b89ba06e-6771-4dea-a605-fe2e2bcbc1d9 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-4cf96f42-6231-4c81-8726-a54139da70ea-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (62ce6dfc-fcc6-4106-be1f-0e5728e356d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e0aed-dbc9-435f-9055-60a18ae85266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e0aed-dbc9-435f-9055-60a18ae85266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-467325356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c980879-a0b5-4ec9-83b5-be42a5baa641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:44Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70571043-8a13-4dcb-acdd-24a22ed55f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70571043-8a13-4dcb-acdd-24a22ed55f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f92672c-300d-470a-9e79-7a18cbecf6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f92672c-300d-470a-9e79-7a18cbecf6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c980879-a0b5-4ec9-83b5-be42a5baa641', 'volume_name': 'volume-8c980879-a0b5-4ec9-83b5-be42a5baa641', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527a97f6-fb3a-4974-8571-e4f5ddc46449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527a97f6-fb3a-4974-8571-e4f5ddc46449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031055e5-9f3a-400f-aed0-993d0cda60d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Volume 8c980879-a0b5-4ec9-83b5-be42a5baa641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c980879-a0b5-4ec9-83b5-be42a5baa641', 'volume_size': 1} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-467325356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c980879-a0b5-4ec9-83b5-be42a5baa641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:44Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Creating volume 8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:44 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:44 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 1073741824 Jul 25 02:37:44 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:44 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 1073741824" returned: 0 in 0.524s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:44 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:37:44 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:45 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.409s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031055e5-9f3a-400f-aed0-993d0cda60d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c980879-a0b5-4ec9-83b5-be42a5baa641', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0557170-0002-45e7-bcd0-9d60fbfe7d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (cb4c911a-9e27-4774-8e22-45c96d2a4c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a567266-afbf-4fe2-baf0-d038f235b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Volume volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 (8c980879-a0b5-4ec9-83b5-be42a5baa641): created successfully Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0557170-0002-45e7-bcd0-9d60fbfe7d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (62ce6dfc-fcc6-4106-be1f-0e5728e356d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a567266-afbf-4fe2-baf0-d038f235b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938952772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:45Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa370cbb-e01d-4861-b345-457f10e3ebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa370cbb-e01d-4861-b345-457f10e3ebb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905ab4ca-04f6-4603-aeef-275584b91233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905ab4ca-04f6-4603-aeef-275584b91233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24bee7f-2742-4fcf-b8b0-f4082b5f5f2c', 'volume_name': 'volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b255d8e-2ebe-4311-b45c-6e92bf012c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b255d8e-2ebe-4311-b45c-6e92bf012c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe0d936-c405-40f6-a404-2e5936de95f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Volume d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c', 'volume_size': 1} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938952772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:45Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Creating volume d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:45 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-474ea886-0fae-4692-b010-275796d9da79 tempest-VolumesSnapshotTestJSON-986118049 None] Created volume successfully. Jul 25 02:37:45 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c 1073741824 Jul 25 02:37:45 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (bcf645e7-69f3-4036-8d74-ad98aa001991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804fd4e5-fe6a-4182-bd88-add4c2dd3bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804fd4e5-fe6a-4182-bd88-add4c2dd3bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1621016440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c99084c-f359-470f-95fb-b532ad1cc415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:46Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d620a2-d65f-43b9-a668-81fd7f42b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d620a2-d65f-43b9-a668-81fd7f42b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c09affa-a805-4d06-825b-92b67e2e4705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c09affa-a805-4d06-825b-92b67e2e4705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c99084c-f359-470f-95fb-b532ad1cc415', 'volume_name': 'volume-5c99084c-f359-470f-95fb-b532ad1cc415', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d567bfb-40bb-42c1-91d8-c7dd1964cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d567bfb-40bb-42c1-91d8-c7dd1964cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce3c799-97cc-4429-9a2c-8f17dcb509ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Volume 5c99084c-f359-470f-95fb-b532ad1cc415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c99084c-f359-470f-95fb-b532ad1cc415', 'volume_size': 1} Jul 25 02:37:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:46 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c 1073741824" returned: 0 in 0.591s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:46 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c Jul 25 02:37:46 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (3b3bfc15-2626-4e91-94fa-3f3db7be7c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaa1a5a-812c-434d-aaee-765f628375bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaa1a5a-812c-434d-aaee-765f628375bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1689584770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196b2071-0ce8-490b-a76f-52bef8594e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:46Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9a107b-f35a-4c11-96c9-37133d736578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9a107b-f35a-4c11-96c9-37133d736578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b667496-eb8a-43f8-8341-48c03d7f167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b667496-eb8a-43f8-8341-48c03d7f167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196b2071-0ce8-490b-a76f-52bef8594e5b', 'volume_name': 'volume-196b2071-0ce8-490b-a76f-52bef8594e5b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ad4397-db20-4a9c-bab4-99b6dcbca6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ad4397-db20-4a9c-bab4-99b6dcbca6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7ac7e3-6ba4-4a0d-bec5-f4f3938c409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Volume 196b2071-0ce8-490b-a76f-52bef8594e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196b2071-0ce8-490b-a76f-52bef8594e5b', 'volume_size': 1} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:46 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c" returned: 0 in 0.387s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1621016440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c99084c-f359-470f-95fb-b532ad1cc415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:46Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Creating volume 5c99084c-f359-470f-95fb-b532ad1cc415 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:46 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:46 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 1073741824 Jul 25 02:37:46 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe0d936-c405-40f6-a404-2e5936de95f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d648b254-61c9-405c-9574-4f5a536766ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Volume volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c (d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c): created successfully Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d648b254-61c9-405c-9574-4f5a536766ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (cb4c911a-9e27-4774-8e22-45c96d2a4c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-936c72bd-a366-4cb2-902d-e6de0c361c7f tempest-CreateVolumesFromImageTest-1441560782 None] Created volume successfully. Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (ba765855-007e-4836-a406-146610825ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c49f20-5b42-4502-9ea7-6fd54e84c84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c49f20-5b42-4502-9ea7-6fd54e84c84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985558654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b2ddf3-8c4d-4703-95b0-21704ec6d6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:47Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e134d7-0061-43bb-a3ee-e9278ca3c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e134d7-0061-43bb-a3ee-e9278ca3c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f36ee3-b8e0-43a9-bc8f-d168eb55c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f36ee3-b8e0-43a9-bc8f-d168eb55c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b2ddf3-8c4d-4703-95b0-21704ec6d6b5', 'volume_name': 'volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4427d793-ac74-45be-b3ae-ffe394d581d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4427d793-ac74-45be-b3ae-ffe394d581d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad63d3-ca31-4b83-a46f-8f3b4a3e5f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:46 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Volume 23b2ddf3-8c4d-4703-95b0-21704ec6d6b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5', 'volume_size': 1} Jul 25 02:37:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:47 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 1073741824" returned: 0 in 0.543s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:47 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 Jul 25 02:37:47 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (084736fc-7b48-46e3-b4f8-05c857b60408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed156e65-8ed6-4a92-98e7-ca4b5957b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed156e65-8ed6-4a92-98e7-ca4b5957b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1101718444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c236413-53ff-4b96-99e2-69792fbe03ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:47Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e049985d-07b0-4c3d-95b2-027f70426a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e049985d-07b0-4c3d-95b2-027f70426a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b3696b-bbdd-4e6b-94f1-bda97a1b8a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b3696b-bbdd-4e6b-94f1-bda97a1b8a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c236413-53ff-4b96-99e2-69792fbe03ba', 'volume_name': 'volume-0c236413-53ff-4b96-99e2-69792fbe03ba', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb772408-f69f-4793-bde5-ad195ac9b4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb772408-f69f-4793-bde5-ad195ac9b4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e10008e-7627-40f8-8e43-09996e2da1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Volume 0c236413-53ff-4b96-99e2-69792fbe03ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c236413-53ff-4b96-99e2-69792fbe03ba', 'volume_size': 1} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:47 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1689584770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196b2071-0ce8-490b-a76f-52bef8594e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:46Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Creating volume 196b2071-0ce8-490b-a76f-52bef8594e5b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:47 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce3c799-97cc-4429-9a2c-8f17dcb509ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c99084c-f359-470f-95fb-b532ad1cc415', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b 1073741824 Jul 25 02:37:47 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a335938c-4533-4aa8-a6c4-7867a132474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Volume volume-5c99084c-f359-470f-95fb-b532ad1cc415 (5c99084c-f359-470f-95fb-b532ad1cc415): created successfully Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a335938c-4533-4aa8-a6c4-7867a132474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (bcf645e7-69f3-4036-8d74-ad98aa001991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:47 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-38a0ea25-c2e7-4e1f-a641-9a4e0f6d2995 tempest-CreateVolumesFromImageTest-1441560782 None] Created volume successfully. Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Flow 'volume_create_manager' (2295fc41-1de1-4fa9-99d2-1b6568eba56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7503d106-1c87-483f-a08f-e6ab71ff0948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7503d106-1c87-483f-a08f-e6ab71ff0948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-237099498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c10ccc6-6215-4af6-bdee-bad8d88b3331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba7574934ae4335af42e67aee065ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:47Z,use_quota=True,user_id='e28241655f04490f952777abb3392001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5b64c6-18eb-4fcd-acba-c29b4c112ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5b64c6-18eb-4fcd-acba-c29b4c112ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff961378-b84a-4d49-9ebd-86feb937a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff961378-b84a-4d49-9ebd-86feb937a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c10ccc6-6215-4af6-bdee-bad8d88b3331', 'volume_name': 'volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d861bc7b-caf4-4360-9171-dd1fe9113b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d861bc7b-caf4-4360-9171-dd1fe9113b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42981f6b-7c80-4b37-b883-b029c2a15d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:47 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Volume 9c10ccc6-6215-4af6-bdee-bad8d88b3331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331', 'volume_size': 1} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:47 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b 1073741824" returned: 0 in 0.405s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:47 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b Jul 25 02:37:47 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:48 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b" returned: 0 in 0.250s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.356s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7ac7e3-6ba4-4a0d-bec5-f4f3938c409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196b2071-0ce8-490b-a76f-52bef8594e5b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329fb427-5453-480f-8137-60baf83d5987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Creating offline snapshot 3453fa3a-ff98-4128-9aa7-359456298343 of volume 8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:37:48 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Volume volume-196b2071-0ce8-490b-a76f-52bef8594e5b (196b2071-0ce8-490b-a76f-52bef8594e5b): created successfully Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329fb427-5453-480f-8137-60baf83d5987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (3b3bfc15-2626-4e91-94fa-3f3db7be7c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0f371-9c7a-4fd3-b8d5-bae82ed7a429]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b4a90c90-1dd4-4391-bebc-fda311628e89 tempest-CreateVolumesFromImageTest-1441560782 None] Created volume successfully. Jul 25 02:37:48 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:37:48 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:48 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:48 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 1G Jul 25 02:37:48 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:48 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 1G" returned: 0 in 0.386s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:48 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 Jul 25 02:37:48 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:49 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343" returned: 0 in 0.279s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:49 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 is being set with open permissions: ugo+rw Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:49 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 Jul 25 02:37:49 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:49 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:49 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info Jul 25 02:37:49 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:49 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:49 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info is being set with open permissions: ugo+rw Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:49 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info Jul 25 02:37:49 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:49 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.info" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.089s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985558654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b2ddf3-8c4d-4703-95b0-21704ec6d6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:47Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Creating volume 23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:49 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:49 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 1073741824 Jul 25 02:37:49 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dc694266-7ba9-4659-8b2a-c0a6c80a2746 tempest-VolumesSnapshotTestJSON-986118049 None] Create snapshot completed successfully Jul 25 02:37:50 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 1073741824" returned: 0 in 0.407s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:50 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 Jul 25 02:37:50 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:50 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5" returned: 0 in 0.232s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1101718444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c236413-53ff-4b96-99e2-69792fbe03ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96880a8e69a49d68dea3e99599c8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:47Z,use_quota=True,user_id='f7af73a4b1d0400faee21593b5667954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Creating volume 0c236413-53ff-4b96-99e2-69792fbe03ba {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:50 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad63d3-ca31-4b83-a46f-8f3b4a3e5f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:50 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba 1073741824 Jul 25 02:37:50 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7981467d-37c0-468e-b5f3-4f103d1efbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:50 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Volume volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 (23b2ddf3-8c4d-4703-95b0-21704ec6d6b5): created successfully Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7981467d-37c0-468e-b5f3-4f103d1efbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (ba765855-007e-4836-a406-146610825ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-24172c3a-1284-4536-a29c-ace3068f735d tempest-CreateVolumesFromImageTest-1441560782 None] Created volume successfully. Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:50 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:50 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:51 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:37:51 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba 1073741824" returned: 0 in 0.589s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:51 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba Jul 25 02:37:51 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (2f8db076-db67-437b-85f4-64db0bc4d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4c1b48-6651-4747-984a-766e70df8568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4c1b48-6651-4747-984a-766e70df8568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-409955230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668b1a7d-67d6-488e-983d-8f120aeeeb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3453fa3a-ff98-4128-9aa7-359456298343,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:51Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c21f562-49da-4022-8f0c-b635e565eda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c21f562-49da-4022-8f0c-b635e565eda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f6c407-8712-4eb8-99ae-618e478b3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f6c407-8712-4eb8-99ae-618e478b3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '668b1a7d-67d6-488e-983d-8f120aeeeb7c', 'volume_name': 'volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c', 'volume_size': 2, 'snapshot_id': '3453fa3a-ff98-4128-9aa7-359456298343'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05314726-8800-427d-bc62-7c21fc29b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05314726-8800-427d-bc62-7c21fc29b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b769c8-976e-4c02-9fa9-f82d25be9ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:51 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Volume 668b1a7d-67d6-488e-983d-8f120aeeeb7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c', 'volume_size': 2, 'snapshot_id': '3453fa3a-ff98-4128-9aa7-359456298343'} Jul 25 02:37:51 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba" returned: 0 in 0.319s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.037s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-237099498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c10ccc6-6215-4af6-bdee-bad8d88b3331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba7574934ae4335af42e67aee065ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:37:47Z,use_quota=True,user_id='e28241655f04490f952777abb3392001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Creating volume 9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:51 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:51 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 1073741824 Jul 25 02:37:51 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e10008e-7627-40f8-8e43-09996e2da1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c236413-53ff-4b96-99e2-69792fbe03ba', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c60e85a-4e2d-4310-bb00-89f186946ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:51 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Volume volume-0c236413-53ff-4b96-99e2-69792fbe03ba (0c236413-53ff-4b96-99e2-69792fbe03ba): created successfully Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c60e85a-4e2d-4310-bb00-89f186946ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Flow 'volume_create_manager' (084736fc-7b48-46e3-b4f8-05c857b60408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:51 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-810a3880-34c4-4aa6-ba95-2e39b503dc2b tempest-CreateVolumesFromImageTest-1441560782 None] Created volume successfully. Jul 25 02:37:52 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 1073741824" returned: 0 in 0.444s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:52 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 Jul 25 02:37:52 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:52 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331" returned: 0 in 0.264s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.731s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-3453fa3a-ff98-4128-9aa7-359456298343-668b1a7d-67d6-488e-983d-8f120aeeeb7c" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42981f6b-7c80-4b37-b883-b029c2a15d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103edde5-56e3-4880-9f89-b9bf821c5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-3453fa3a-ff98-4128-9aa7-359456298343-668b1a7d-67d6-488e-983d-8f120aeeeb7c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Creating volume 668b1a7d-67d6-488e-983d-8f120aeeeb7c from snapshot 3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-668b1a7d-67d6-488e-983d-8f120aeeeb7c" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:52 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Volume volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 (9c10ccc6-6215-4af6-bdee-bad8d88b3331): created successfully Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103edde5-56e3-4880-9f89-b9bf821c5201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Flow 'volume_create_manager' (2295fc41-1de1-4fa9-99d2-1b6568eba56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-668b1a7d-67d6-488e-983d-8f120aeeeb7c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] snapshot: 3453fa3a-ff98-4128-9aa7-359456298343, volume: 668b1a7d-67d6-488e-983d-8f120aeeeb7c, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:37:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-40bc74ef-bf3b-466e-bde4-73901b69f144 tempest-SnapshotMetadataTestJSON-139561452 None] Created volume successfully. Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[661512f2-6984-4b83-a1e3-497721e83411]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:52 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 Jul 25 02:37:52 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-0c236413-53ff-4b96-99e2-69792fbe03ba-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-0c236413-53ff-4b96-99e2-69792fbe03ba-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-quobyte-0c236413-53ff-4b96-99e2-69792fbe03ba" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-0c236413-53ff-4b96-99e2-69792fbe03ba" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d88150d-b6ee-4fd2-aacf-74dd6c6cd3d0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:52 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343" returned: 0 in 0.473s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c980879-a0b5-4ec9-83b5-be42a5baa641(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:37:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd475d-8776-4c6c-af99-d07068560bd2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:53 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba Jul 25 02:37:53 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:53 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:37:53 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:53 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba" returned: 0 in 0.559s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:53 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba Jul 25 02:37:53 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:53 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.491s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:53 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c Jul 25 02:37:53 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:53 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0c236413-53ff-4b96-99e2-69792fbe03ba" returned: 0 in 0.405s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-0c236413-53ff-4b96-99e2-69792fbe03ba" released by "delete_volume" :: held 1.033s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:53 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Created reservations ['19ac7c87-ee52-4a85-8705-a005261ceee4', '63c7995a-312f-4482-b8b9-20bc894b088c', '558845b5-7a8e-484b-9123-2597e4e6d716', '5ace0794-ee72-4548-a984-b857543fe818'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:54 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:54 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:54 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.380s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Deleted volume successfully. Jul 25 02:37:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-495be11a-1de9-49a0-8a4b-640bb2c6f417 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-0c236413-53ff-4b96-99e2-69792fbe03ba-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-quobyte-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7270199-b17b-4887-a150-06f72bd24a92]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:55 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 Jul 25 02:37:55 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:56 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5" returned: 0 in 0.848s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:56 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5 Jul 25 02:37:56 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:56 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5" returned: 0 in 0.850s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5" released by "delete_volume" :: held 1.808s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Created reservations ['978e6c77-ff0b-49b0-a54c-86c6d5af2038', 'f4f4ace2-b4bd-4333-89b4-86caaab0e447', '01eb34a5-de7c-4958-b873-f0336e15e1e2', '6fa16452-4949-42c2-a8b1-4f340062f6ec'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:57 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:37:57 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-196b2071-0ce8-490b-a76f-52bef8594e5b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-196b2071-0ce8-490b-a76f-52bef8594e5b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-quobyte-196b2071-0ce8-490b-a76f-52bef8594e5b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:37:57 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.495s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:37:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Deleted volume successfully. Jul 25 02:37:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-196b2071-0ce8-490b-a76f-52bef8594e5b" acquired by "delete_volume" :: waited 0.046s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:37:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-390cf6af-5360-41c3-832b-4f0a839d32e0 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-23b2ddf3-8c4d-4703-95b0-21704ec6d6b5-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a410b-f191-4949-acaa-95778ab6c9f6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:58 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b Jul 25 02:37:58 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:59 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b" returned: 0 in 1.523s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:59 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b Jul 25 02:37:59 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:59 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c" returned: 0 in 6.112s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae591f-ab11-4e9f-bd67-b7cdceec3a3f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:37:59 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:37:59 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:37:59 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-196b2071-0ce8-490b-a76f-52bef8594e5b" returned: 0 in 0.274s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-196b2071-0ce8-490b-a76f-52bef8594e5b" released by "delete_volume" :: held 1.917s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=127,cinder:INSERT=41,cinder:UPDATE=128,cinder:DELETE=10 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=126,cinder:UPDATE=151,cinder:DELETE=12,cinder:INSERT=30 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:37:59 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Created reservations ['f8892fab-36b9-4f5c-be91-9805618dcdc7', '88e315b1-1ecc-4b4a-9400-db32a646f7dc', 'c27cd50b-b3d0-4852-8cf2-ff3d70595142', '5723f52a-ba75-4d0f-8922-ce7254d3d391'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:00 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:00 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-5c99084c-f359-470f-95fb-b532ad1cc415-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-5c99084c-f359-470f-95fb-b532ad1cc415-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:00 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.652s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:38:00 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Converted 1024.00 MB image at 167.49 MB/s Jul 25 02:38:00 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c is being set with open permissions: ugo+rw Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-quobyte-5c99084c-f359-470f-95fb-b532ad1cc415" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:00 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c Jul 25 02:38:00 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-5c99084c-f359-470f-95fb-b532ad1cc415" acquired by "delete_volume" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:00 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[937aec7f-1884-450e-b1f7-fe27b6014573]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Deleted volume successfully. Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a21655f9-4629-42dd-a27d-1a882010c457 tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-196b2071-0ce8-490b-a76f-52bef8594e5b-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:00 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 Jul 25 02:38:00 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:00 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c" returned: 0 in 0.282s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-668b1a7d-67d6-488e-983d-8f120aeeeb7c" released by "_copy_volume_from_snapshot" :: held 8.164s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-3453fa3a-ff98-4128-9aa7-359456298343-668b1a7d-67d6-488e-983d-8f120aeeeb7c" released by "_create_volume_from_snapshot" :: held 8.211s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.242s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.480s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Creating offline snapshot b7688554-b27a-42c1-acfe-28bf8b3a7259 of volume 9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b769c8-976e-4c02-9fa9-f82d25be9ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c', 'volume_size': 2, 'snapshot_id': '3453fa3a-ff98-4128-9aa7-359456298343'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7b5812-dff1-41de-a4db-98c88655c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d2ec9c-2938-4d60-a1c7-74ef6c7ff41c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Volume volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c (668b1a7d-67d6-488e-983d-8f120aeeeb7c): created successfully Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7b5812-dff1-41de-a4db-98c88655c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (2f8db076-db67-437b-85f4-64db0bc4d352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-54e53558-1a8c-4606-b4ca-a67d3a377332 tempest-VolumesSnapshotTestJSON-986118049 None] Created volume successfully. Jul 25 02:38:00 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:00 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 Jul 25 02:38:00 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:00 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415 Jul 25 02:38:00 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:01 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:01 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5c99084c-f359-470f-95fb-b532ad1cc415" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331" returned: 0 in 0.430s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-5c99084c-f359-470f-95fb-b532ad1cc415" released by "delete_volume" :: held 0.770s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:01 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 1G Jul 25 02:38:01 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Created reservations ['aba8285f-ba72-4583-bacb-aa56ae5a4975', '9dcb2f4a-edd0-4055-bb00-488c9d7b9e7f', 'c7505eeb-6f68-44a1-b84f-189e7cafd8da', '97c216a5-06ba-427d-9bc0-c122f31b727a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:01 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:01 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "cinder-quobyte-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:01 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-668b1a7d-67d6-488e-983d-8f120aeeeb7c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a34fbf-777c-4b3c-b8cd-581756fdb06a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Deleted volume successfully. Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-668b1a7d-67d6-488e-983d-8f120aeeeb7c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:01 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 1G" returned: 0 in 0.619s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-88d4e71c-1145-454d-baad-51da2be1876d tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-5c99084c-f359-470f-95fb-b532ad1cc415-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-668b1a7d-67d6-488e-983d-8f120aeeeb7c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:01 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 Jul 25 02:38:01 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-668b1a7d-67d6-488e-983d-8f120aeeeb7c" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab89c5e-fd8d-468b-b83d-41b684492ca7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:01 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c Jul 25 02:38:01 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:01 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c Jul 25 02:38:01 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 is being set with open permissions: ugo+rw Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 Jul 25 02:38:02 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c" returned: 0 in 0.488s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c Jul 25 02:38:02 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c" returned: 0 in 0.410s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c Jul 25 02:38:02 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c" returned: 0 in 0.264s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-quobyte-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c" released by "delete_volume" :: held 0.827s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info Jul 25 02:38:02 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Created reservations ['d784923d-efe0-4232-8a00-14236ac03ad4', 'f3b1f9f8-65ac-4dcd-99ca-a635ff7dce49', '91907e3d-b299-46e1-8736-c23989aee72c', '8c2263fa-9539-4076-88d6-36c1efb4b48f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:02 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-668b1a7d-67d6-488e-983d-8f120aeeeb7c" returned: 0 in 0.314s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-668b1a7d-67d6-488e-983d-8f120aeeeb7c" released by "delete_volume" :: held 0.783s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['58dfb96b-ba87-4abc-ab9a-6a59a1faa8fd', '2780aca6-5afc-47f4-aba1-a61a6a2c750d', '9b966651-a5dc-476e-876c-f0fc9226ce36', 'a9c5c20b-c4c7-4e4d-b65d-67ff7b9df461'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:02 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:02 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info" returned: 0 in 0.364s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:02 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info is being set with open permissions: ugo+rw Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:02 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:02 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info Jul 25 02:38:02 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-3453fa3a-ff98-4128-9aa7-359456298343-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-3453fa3a-ff98-4128-9aa7-359456298343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-8c980879-a0b5-4ec9-83b5-be42a5baa641" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-8c980879-a0b5-4ec9-83b5-be42a5baa641" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-3453fa3a-ff98-4128-9aa7-359456298343" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-3453fa3a-ff98-4128-9aa7-359456298343" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Deleting offline snapshot 3453fa3a-ff98-4128-9aa7-359456298343 of volume 8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] snapshot_file for this snap is: volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40fcf46-360f-4238-b2dc-6698bcbbe7cf]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:03 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.553s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Deleted volume successfully. Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7c39d8ea-2a79-474f-8d9f-b61c84f7f37c tempest-CreateVolumesFromImageTest-1441560782 None] Lock "cinder-d24bee7f-2742-4fcf-b8b0-f4082b5f5f2c-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:03 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 Jul 25 02:38:03 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:03 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.551s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Deleted volume successfully. Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eceb469c-7096-4ea5-8d11-ed51c3f571e8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-668b1a7d-67d6-488e-983d-8f120aeeeb7c-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:03 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.info" returned: 0 in 0.565s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e27b335d-4a2b-413b-9b1c-24ada34064f3 tempest-SnapshotMetadataTestJSON-139561452 None] Create snapshot completed successfully Jul 25 02:38:03 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343" returned: 0 in 0.560s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c980879-a0b5-4ec9-83b5-be42a5baa641(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f1aae-0f3c-4c9c-8e6c-9685b4a3582e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:03 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:38:03 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:04 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.526s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:04 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 Jul 25 02:38:04 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:04 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343" returned: 0 in 0.441s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:04 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343 Jul 25 02:38:04 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "cinder-b7688554-b27a-42c1-acfe-28bf8b3a7259-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-b7688554-b27a-42c1-acfe-28bf8b3a7259-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "cinder-quobyte-9c10ccc6-6215-4af6-bdee-bad8d88b3331" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-quobyte-9c10ccc6-6215-4af6-bdee-bad8d88b3331" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "cinder-quobyte-b7688554-b27a-42c1-acfe-28bf8b3a7259" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-quobyte-b7688554-b27a-42c1-acfe-28bf8b3a7259" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Deleting offline snapshot b7688554-b27a-42c1-acfe-28bf8b3a7259 of volume 9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] snapshot_file for this snap is: volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c07a22e-e01b-4536-8251-35bebdf783b4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:05 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641.3453fa3a-ff98-4128-9aa7-359456298343" returned: 0 in 0.408s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:05 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 Jul 25 02:38:05 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-3453fa3a-ff98-4128-9aa7-359456298343" released by "_delete_snapshot" :: held 2.138s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-8c980879-a0b5-4ec9-83b5-be42a5baa641" released by "delete_snapshot" :: held 2.174s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['882a23aa-4caa-4a9c-a216-31e19ac11245', 'a90547f5-d8a9-4adc-bfad-f989586528dd', '391a0498-9785-4d0a-a247-d0788b80df14', '21203702-7c27-4709-9420-f3ce2bb57c2e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Delete snapshot completed successfully. Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-728eeb00-197d-408f-8862-061958fd59bc tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-3453fa3a-ff98-4128-9aa7-359456298343-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:05 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259" returned: 0 in 0.518s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f07d3-4225-4e12-9025-62825f3aad15]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:05 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 Jul 25 02:38:05 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:06 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331" returned: 0 in 0.471s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:06 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 Jul 25 02:38:06 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-8c980879-a0b5-4ec9-83b5-be42a5baa641-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-8c980879-a0b5-4ec9-83b5-be42a5baa641-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-8c980879-a0b5-4ec9-83b5-be42a5baa641" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-8c980879-a0b5-4ec9-83b5-be42a5baa641" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c09c18-d5e1-4681-89e8-1f192cc5bb3d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:06 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:38:06 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:06 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259" returned: 0 in 0.681s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:06 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259 Jul 25 02:38:06 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:07 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.475s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:07 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331.b7688554-b27a-42c1-acfe-28bf8b3a7259" returned: 0 in 0.304s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:07 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641 Jul 25 02:38:07 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-quobyte-b7688554-b27a-42c1-acfe-28bf8b3a7259" released by "_delete_snapshot" :: held 2.163s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-quobyte-9c10ccc6-6215-4af6-bdee-bad8d88b3331" released by "delete_snapshot" :: held 2.207s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Created reservations ['6898fc0b-1127-4fc3-8fe8-13463db5d948', 'c039a24f-16c5-4d45-8a8e-bff77ee86d81', 'eb476484-3cb4-4ae9-8880-2b1032ac24f0', 'cc7ef0ad-e7fe-4146-9a25-c84e0b5cdbe0'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Delete snapshot completed successfully. Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-24baad13-7dc8-49e1-bc27-fcc5307da2c9 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-b7688554-b27a-42c1-acfe-28bf8b3a7259-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:07 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8c980879-a0b5-4ec9-83b5-be42a5baa641" returned: 0 in 0.358s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-8c980879-a0b5-4ec9-83b5-be42a5baa641" released by "delete_volume" :: held 0.900s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['993b3157-be59-4625-85d1-726b55cc1765', '2026f34e-cbe9-4bb4-aace-2e5ec5dc0888', '4ace8b84-4f22-4ec6-b0d8-fb6fcb1ee216', 'b6496e8e-4c34-4d7d-8206-a0d898585f6a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:07 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:07 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:07 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.310s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:07 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Deleted volume successfully. Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2316a791-1116-4771-bd54-bee696355af8 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-8c980879-a0b5-4ec9-83b5-be42a5baa641-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "cinder-9c10ccc6-6215-4af6-bdee-bad8d88b3331-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-9c10ccc6-6215-4af6-bdee-bad8d88b3331-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "cinder-quobyte-9c10ccc6-6215-4af6-bdee-bad8d88b3331" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-quobyte-9c10ccc6-6215-4af6-bdee-bad8d88b3331" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca557c0c-8a57-461f-b82e-b548529515b8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:08 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 Jul 25 02:38:08 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:09 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331" returned: 0 in 0.829s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:09 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331 Jul 25 02:38:09 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:09 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c10ccc6-6215-4af6-bdee-bad8d88b3331" returned: 0 in 0.470s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-quobyte-9c10ccc6-6215-4af6-bdee-bad8d88b3331" released by "delete_volume" :: held 1.407s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (3d7abd50-d4cd-479b-af8c-f27f037715f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d86b2c3-e0f4-4552-a9ae-261171faa983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d86b2c3-e0f4-4552-a9ae-261171faa983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-354430305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b86dcf-00f4-4898-8c05-a3f2249805ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:10Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1f3a62-d4ce-41cd-bccd-2c32c35ff00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1f3a62-d4ce-41cd-bccd-2c32c35ff00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90784f18-158f-4984-a2e9-e2dfeec77a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90784f18-158f-4984-a2e9-e2dfeec77a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b86dcf-00f4-4898-8c05-a3f2249805ad', 'volume_name': 'volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad11093-5624-4da6-aa38-fc39380f5568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad11093-5624-4da6-aa38-fc39380f5568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123c3489-ad36-4039-a671-76c32975a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:10 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Volume e7b86dcf-00f4-4898-8c05-a3f2249805ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad', 'volume_size': 1} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-354430305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b86dcf-00f4-4898-8c05-a3f2249805ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:10Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Creating volume e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:10 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:10 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad 1073741824 Jul 25 02:38:10 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Created reservations ['37494d26-8169-4c58-949f-b4a54a5365b9', 'b1a962db-6e35-4c44-95e1-03ede6ab40ed', '283276f0-7777-4541-a533-ca73bbdae4e3', 'a55368ff-23bf-40ec-b29a-12aab0720395'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:10 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:10 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:10 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.438s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Deleted volume successfully. Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7a5f6036-4b20-498b-b93e-d7c6f37c90f7 tempest-SnapshotMetadataTestJSON-139561452 None] Lock "cinder-9c10ccc6-6215-4af6-bdee-bad8d88b3331-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:10 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad 1073741824" returned: 0 in 0.778s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:10 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:10 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:11 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123c3489-ad36-4039-a671-76c32975a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96732dc1-6c05-4612-8189-d8ad3ea72522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:11 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Volume volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad (e7b86dcf-00f4-4898-8c05-a3f2249805ad): created successfully Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96732dc1-6c05-4612-8189-d8ad3ea72522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (3d7abd50-d4cd-479b-af8c-f27f037715f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b8247f3d-1159-439e-842c-8e2e11083a53 tempest-VolumesSnapshotTestJSON-986118049 None] Created volume successfully. Jul 25 02:38:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Creating offline snapshot 11a98878-71e1-41c0-8074-930aa27fe845 of volume e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:38:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c1a21-2f77-46d7-9328-bfa7f0c5fa3f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:12 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:12 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:13 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.666s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:13 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 1G Jul 25 02:38:13 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:14 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 1G" returned: 0 in 0.891s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:14 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 Jul 25 02:38:14 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:14 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845" returned: 0 in 0.482s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:14 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 is being set with open permissions: ugo+rw Jul 25 02:38:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:14 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 Jul 25 02:38:14 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:15 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:15 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info Jul 25 02:38:15 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:15 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info" returned: 0 in 0.431s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:15 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info is being set with open permissions: ugo+rw Jul 25 02:38:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:15 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info Jul 25 02:38:15 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:15 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.info" returned: 0 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.402s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:15 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e9f9e3b1-6694-48f1-8d0f-b497b35618e7 tempest-VolumesSnapshotTestJSON-986118049 None] Create snapshot completed successfully Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Flow 'volume_create_manager' (65fb4dcc-0227-4316-9c06-9c05185f1850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e140a5-e889-4695-9374-f87c68c5fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e140a5-e889-4695-9374-f87c68c5fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-69268486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1250735-594d-4dcd-993d-5e653a5517e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9820dc50d6304c36831dea7dd947c0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:17Z,use_quota=True,user_id='609f70e1059144c6b3672d7f5df9b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b3b138-d670-4cfe-bf83-51e0b92adc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b3b138-d670-4cfe-bf83-51e0b92adc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbed08a-8265-47bc-97ab-d470f611844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbed08a-8265-47bc-97ab-d470f611844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1250735-594d-4dcd-993d-5e653a5517e8', 'volume_name': 'volume-b1250735-594d-4dcd-993d-5e653a5517e8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928088f6-5df7-4bdd-b633-deeed62e46f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928088f6-5df7-4bdd-b633-deeed62e46f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2c5c03-f80a-4e0a-9248-03e73a9b13da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:16 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Volume b1250735-594d-4dcd-993d-5e653a5517e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1250735-594d-4dcd-993d-5e653a5517e8', 'volume_size': 1} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-69268486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1250735-594d-4dcd-993d-5e653a5517e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9820dc50d6304c36831dea7dd947c0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:17Z,use_quota=True,user_id='609f70e1059144c6b3672d7f5df9b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Creating volume b1250735-594d-4dcd-993d-5e653a5517e8 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:16 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:38:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:16 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 1073741824 Jul 25 02:38:16 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:17 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 1073741824" returned: 0 in 0.540s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:17 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 Jul 25 02:38:17 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (16477d6b-39a3-42be-866f-189c5bac3fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8022ab-c965-48b8-84c7-77cb963b1487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8022ab-c965-48b8-84c7-77cb963b1487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-333278737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f9a19e-7644-420f-9877-5d24b7f3ae72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4423a598eae148e1af82b943074dbf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11a98878-71e1-41c0-8074-930aa27fe845,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:18Z,use_quota=True,user_id='82eac14ef59f4982add298cb3cd7fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829d1d53-b32c-4c1d-920c-207da682a38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829d1d53-b32c-4c1d-920c-207da682a38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8013da-4c03-4d89-a546-9830b9128bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8013da-4c03-4d89-a546-9830b9128bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42f9a19e-7644-420f-9877-5d24b7f3ae72', 'volume_name': 'volume-42f9a19e-7644-420f-9877-5d24b7f3ae72', 'volume_size': 1, 'snapshot_id': '11a98878-71e1-41c0-8074-930aa27fe845'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300edee0-2247-4b2f-85e0-34228308c0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300edee0-2247-4b2f-85e0-34228308c0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8076bd0e-906e-49be-9e5b-2711969cc652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:17 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Volume 42f9a19e-7644-420f-9877-5d24b7f3ae72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42f9a19e-7644-420f-9877-5d24b7f3ae72', 'volume_size': 1, 'snapshot_id': '11a98878-71e1-41c0-8074-930aa27fe845'} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:17 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.080s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-11a98878-71e1-41c0-8074-930aa27fe845-42f9a19e-7644-420f-9877-5d24b7f3ae72" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2c5c03-f80a-4e0a-9248-03e73a9b13da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1250735-594d-4dcd-993d-5e653a5517e8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c034884e-f69f-4641-9c91-87df743a4d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-11a98878-71e1-41c0-8074-930aa27fe845-42f9a19e-7644-420f-9877-5d24b7f3ae72" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Creating volume 42f9a19e-7644-420f-9877-5d24b7f3ae72 from snapshot 11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-42f9a19e-7644-420f-9877-5d24b7f3ae72" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:17 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Volume volume-b1250735-594d-4dcd-993d-5e653a5517e8 (b1250735-594d-4dcd-993d-5e653a5517e8): created successfully Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c034884e-f69f-4641-9c91-87df743a4d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Flow 'volume_create_manager' (65fb4dcc-0227-4316-9c06-9c05185f1850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-42f9a19e-7644-420f-9877-5d24b7f3ae72" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] snapshot: 11a98878-71e1-41c0-8074-930aa27fe845, volume: 42f9a19e-7644-420f-9877-5d24b7f3ae72, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0ede5984-0216-479c-81a9-b6f1e5df89a2 tempest-AbsoluteLimitsTests-534317389 None] Created volume successfully. Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04e772-0626-4c7f-bf60-1ce4fb14d2ca]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:18 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 Jul 25 02:38:18 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:18 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845" returned: 0 in 0.394s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fcd81b-1605-4784-ab21-38238a18b6b8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:18 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:18 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:18 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.416s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:38:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:18 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 Jul 25 02:38:18 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Acquiring lock "cinder-b1250735-594d-4dcd-993d-5e653a5517e8-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Lock "cinder-b1250735-594d-4dcd-993d-5e653a5517e8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Acquiring lock "cinder-quobyte-b1250735-594d-4dcd-993d-5e653a5517e8" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Lock "cinder-quobyte-b1250735-594d-4dcd-993d-5e653a5517e8" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:19 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c8ac14-5fd2-408b-8a1e-176a6dbbbc2a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:19 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 Jul 25 02:38:19 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:20 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8" returned: 0 in 1.292s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:20 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8 Jul 25 02:38:20 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:21 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1250735-594d-4dcd-993d-5e653a5517e8" returned: 0 in 0.612s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Lock "cinder-quobyte-b1250735-594d-4dcd-993d-5e653a5517e8" released by "delete_volume" :: held 1.992s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Created reservations ['9d34def0-6a7a-476f-857c-c2cde3d302f9', '1817f11c-f57f-4526-bbc2-8b333ddbda22', '7325f3b1-fc66-427e-a0ca-6a85b0a527e6', 'f0d6aa04-f825-41d9-b6e1-02b3746fd7a3'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:21 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:21 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:22 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.585s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:22 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Deleted volume successfully. Jul 25 02:38:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-450a6a9e-1a93-48c6-9ecc-e917116aa446 tempest-AbsoluteLimitsTests-534317389 None] Lock "cinder-b1250735-594d-4dcd-993d-5e653a5517e8-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:26 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72" returned: 0 in 7.472s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667ebcf-5f58-4371-a624-e2f489014843]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:26 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:26 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:26 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.592s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:26 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:38:26 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Converted 1024.00 MB image at 137.02 MB/s Jul 25 02:38:26 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 is being set with open permissions: ugo+rw Jul 25 02:38:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:26 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 Jul 25 02:38:26 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:27 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72" returned: 0 in 0.298s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-42f9a19e-7644-420f-9877-5d24b7f3ae72" released by "_copy_volume_from_snapshot" :: held 9.281s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-11a98878-71e1-41c0-8074-930aa27fe845-42f9a19e-7644-420f-9877-5d24b7f3ae72" released by "_create_volume_from_snapshot" :: held 9.341s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.375s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8076bd0e-906e-49be-9e5b-2711969cc652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f9a19e-7644-420f-9877-5d24b7f3ae72', 'volume_size': 1, 'snapshot_id': '11a98878-71e1-41c0-8074-930aa27fe845'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d259aa00-c8c7-4456-8536-97dc8431c35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Volume volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 (42f9a19e-7644-420f-9877-5d24b7f3ae72): created successfully Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d259aa00-c8c7-4456-8536-97dc8431c35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Flow 'volume_create_manager' (16477d6b-39a3-42be-866f-189c5bac3fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7ced1f3c-07c3-42e6-9967-214f7eda2357 tempest-VolumesSnapshotTestJSON-986118049 None] Created volume successfully. Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-42f9a19e-7644-420f-9877-5d24b7f3ae72-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-42f9a19e-7644-420f-9877-5d24b7f3ae72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-42f9a19e-7644-420f-9877-5d24b7f3ae72" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-42f9a19e-7644-420f-9877-5d24b7f3ae72" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[018cca93-60f0-4a75-bd73-4132c7eeea4d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:28 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 Jul 25 02:38:28 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:28 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72" returned: 0 in 0.464s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:28 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72 Jul 25 02:38:28 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:29 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-42f9a19e-7644-420f-9877-5d24b7f3ae72" returned: 0 in 0.298s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-42f9a19e-7644-420f-9877-5d24b7f3ae72" released by "delete_volume" :: held 0.811s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['0f2b6b5e-e97e-42cf-9e53-fc2eb1ee30bf', 'a370a9d1-87bb-49f0-9a1d-f87cd5cfbf1a', '4eb13459-1e96-4523-aec2-dde9813e242e', '9ca261fc-9dde-49fd-87d4-e5208e463518'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:29 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:29 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-11a98878-71e1-41c0-8074-930aa27fe845-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-11a98878-71e1-41c0-8074-930aa27fe845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-e7b86dcf-00f4-4898-8c05-a3f2249805ad" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-e7b86dcf-00f4-4898-8c05-a3f2249805ad" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-11a98878-71e1-41c0-8074-930aa27fe845" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-11a98878-71e1-41c0-8074-930aa27fe845" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Deleting offline snapshot 11a98878-71e1-41c0-8074-930aa27fe845 of volume e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:38:29 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] snapshot_file for this snap is: volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Deleted volume successfully. Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9404ec79-bf08-4a49-9189-0005a5981f64]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7e9870ca-bfd6-41b1-948c-d46b009356f7 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-42f9a19e-7644-420f-9877-5d24b7f3ae72-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:29 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 Jul 25 02:38:29 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:30 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845" returned: 0 in 0.543s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:38:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f4242-0410-4cd7-a2f2-55338cfb7369]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:30 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:30 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:30 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.423s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:30 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 Jul 25 02:38:30 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:31 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:31 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845 Jul 25 02:38:31 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:31 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad.11a98878-71e1-41c0-8074-930aa27fe845" returned: 0 in 0.285s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-11a98878-71e1-41c0-8074-930aa27fe845" released by "_delete_snapshot" :: held 1.836s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-e7b86dcf-00f4-4898-8c05-a3f2249805ad" released by "delete_snapshot" :: held 1.868s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['3366c201-1b45-499a-8943-2f495058c853', '8b7f0fea-8b60-4eb0-9251-f41ee9a1340f', 'db0502eb-4f2c-47eb-862c-a9b561fca948', 'c8562598-b3d3-4d32-9367-6a065c56bdbf'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Delete snapshot completed successfully. Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f271ef39-8fcd-4f8c-8d26-0cde1ae82b00 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-11a98878-71e1-41c0-8074-930aa27fe845-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-e7b86dcf-00f4-4898-8c05-a3f2249805ad-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-e7b86dcf-00f4-4898-8c05-a3f2249805ad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-e7b86dcf-00f4-4898-8c05-a3f2249805ad" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-e7b86dcf-00f4-4898-8c05-a3f2249805ad" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab17cd-f48f-41ea-8a59-898192f093ac]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:32 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:32 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:32 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.620s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:32 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad Jul 25 02:38:32 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:33 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e7b86dcf-00f4-4898-8c05-a3f2249805ad" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-e7b86dcf-00f4-4898-8c05-a3f2249805ad" released by "delete_volume" :: held 1.089s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['55140292-007e-45d0-9b45-7b258d56a1c7', 'f265307a-ea75-4455-87fc-5d17de029663', '7d7e77b2-72fa-4c78-a7e8-6cda557e5f17', 'ccd6710c-9bd4-497c-bc5e-e2e4b3fae47b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:33 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:33 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:33 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.399s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Deleted volume successfully. Jul 25 02:38:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d8cdab2-d92d-45fd-9b70-ad70cd793927 tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-e7b86dcf-00f4-4898-8c05-a3f2249805ad-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-c52fa42f-7069-49b6-94df-ed0a719ce9e5-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-c52fa42f-7069-49b6-94df-ed0a719ce9e5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "cinder-quobyte-c52fa42f-7069-49b6-94df-ed0a719ce9e5" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-c52fa42f-7069-49b6-94df-ed0a719ce9e5" acquired by "delete_volume" :: waited 0.040s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:34 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3198f920-2c47-4af1-824b-60f1f535e97f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:34 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 Jul 25 02:38:34 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:35 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5" returned: 0 in 0.545s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:35 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5 Jul 25 02:38:35 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Flow 'volume_create_manager' (96aacad0-5826-4e47-997e-dd375f7df9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950420f-19b4-4717-a7de-2579cd2ef97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950420f-19b4-4717-a7de-2579cd2ef97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-137966227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25d1213-687e-4077-be30-04fd9ee1ffca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1398c53dc2e4ffe860c0eef7c4b7f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:35Z,use_quota=True,user_id='c4cacd9069e04183b7ea1a92a90246b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4729eaa-20cb-4f27-acd5-aaacfb22fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4729eaa-20cb-4f27-acd5-aaacfb22fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9cabbf-8004-491f-9654-3b4ba7407e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9cabbf-8004-491f-9654-3b4ba7407e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25d1213-687e-4077-be30-04fd9ee1ffca', 'volume_name': 'volume-a25d1213-687e-4077-be30-04fd9ee1ffca', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85d3393-1a87-41d6-99c7-5d42a15149f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:35 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85d3393-1a87-41d6-99c7-5d42a15149f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3feb673-596b-47cd-9442-15b62d98460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:35 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Volume a25d1213-687e-4077-be30-04fd9ee1ffca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25d1213-687e-4077-be30-04fd9ee1ffca', 'volume_size': 1} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-137966227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25d1213-687e-4077-be30-04fd9ee1ffca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1398c53dc2e4ffe860c0eef7c4b7f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:35Z,use_quota=True,user_id='c4cacd9069e04183b7ea1a92a90246b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Creating volume a25d1213-687e-4077-be30-04fd9ee1ffca {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:35 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c52fa42f-7069-49b6-94df-ed0a719ce9e5" returned: 0 in 0.446s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:35 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca 1073741824 Jul 25 02:38:35 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-quobyte-c52fa42f-7069-49b6-94df-ed0a719ce9e5" released by "delete_volume" :: held 1.079s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Created reservations ['997c32e8-9ec9-4324-b7cd-0a8337faea2f', '004ddd0d-69a8-45db-83ce-4dba38cf0c88', '9ac565fb-ea84-4dd5-9732-57d6c8c5ff1a', 'e7f14c68-3bb0-4e6b-9916-3d2bad402e1a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:35 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:35 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:36 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.346s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Deleted volume successfully. Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-71250287-7095-450a-a138-df6f4dfebd6f tempest-VolumesSnapshotTestJSON-986118049 None] Lock "cinder-c52fa42f-7069-49b6-94df-ed0a719ce9e5-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:38:36 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca 1073741824" returned: 0 in 0.634s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:36 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca Jul 25 02:38:36 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:36 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca" returned: 0 in 0.302s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3feb673-596b-47cd-9442-15b62d98460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25d1213-687e-4077-be30-04fd9ee1ffca', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae133d6a-e938-480d-98a9-85d21fd97ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:36 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Volume volume-a25d1213-687e-4077-be30-04fd9ee1ffca (a25d1213-687e-4077-be30-04fd9ee1ffca): created successfully Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae133d6a-e938-480d-98a9-85d21fd97ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Flow 'volume_create_manager' (96aacad0-5826-4e47-997e-dd375f7df9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fcbf0a90-ca2d-4b53-b847-38ef4ccb74d7 tempest-AttachVolumeTestJSON-1408405032 None] Created volume successfully. Jul 25 02:38:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-bd9cd26d-30db-4cde-9f75-45c1d926a3d0 req-9ac15270-31a1-425d-9fde-a46e08592e2f tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-bd9cd26d-30db-4cde-9f75-45c1d926a3d0 req-9ac15270-31a1-425d-9fde-a46e08592e2f tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-bd9cd26d-30db-4cde-9f75-45c1d926a3d0 req-9ac15270-31a1-425d-9fde-a46e08592e2f tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-bd9cd26d-30db-4cde-9f75-45c1d926a3d0 req-9ac15270-31a1-425d-9fde-a46e08592e2f tempest-AttachVolumeTestJSON-1408405032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-a25d1213-687e-4077-be30-04fd9ee1ffca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5777270-2575-4e74-99f8-a3de08f39383', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:38:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-bd9cd26d-30db-4cde-9f75-45c1d926a3d0 req-9ac15270-31a1-425d-9fde-a46e08592e2f tempest-AttachVolumeTestJSON-1408405032 None] attachment_update completed successfully. Jul 25 02:38:40 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Flow 'volume_create_manager' (2d4ecfbe-d5df-4eb4-b8ae-501f65d53c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f013e3b0-892b-4f92-a768-8418281485b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f013e3b0-892b-4f92-a768-8418281485b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1403711710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7257b86-ba88-4a2b-ab51-2f4164f5f8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1398c53dc2e4ffe860c0eef7c4b7f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:41Z,use_quota=True,user_id='c4cacd9069e04183b7ea1a92a90246b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195b706a-d091-45be-b7ba-8049360d5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195b706a-d091-45be-b7ba-8049360d5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4680b5d-b63b-4be1-a036-b46852adfbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4680b5d-b63b-4be1-a036-b46852adfbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7257b86-ba88-4a2b-ab51-2f4164f5f8db', 'volume_name': 'volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c940942-59e2-4531-a664-9831408d46b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c940942-59e2-4531-a664-9831408d46b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616ecdcc-dcbb-4f55-b437-b41e2454e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Volume b7257b86-ba88-4a2b-ab51-2f4164f5f8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db', 'volume_size': 1} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1403711710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7257b86-ba88-4a2b-ab51-2f4164f5f8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1398c53dc2e4ffe860c0eef7c4b7f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:41Z,use_quota=True,user_id='c4cacd9069e04183b7ea1a92a90246b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Creating volume b7257b86-ba88-4a2b-ab51-2f4164f5f8db {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:41 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:41 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db 1073741824 Jul 25 02:38:41 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:41 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db 1073741824" returned: 0 in 0.462s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:41 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db Jul 25 02:38:41 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:41 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db" returned: 0 in 0.309s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616ecdcc-dcbb-4f55-b437-b41e2454e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd981b7-5eb2-4788-80f9-b18dacf6b6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Volume volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db (b7257b86-ba88-4a2b-ab51-2f4164f5f8db): created successfully Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd981b7-5eb2-4788-80f9-b18dacf6b6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Flow 'volume_create_manager' (2d4ecfbe-d5df-4eb4-b8ae-501f65d53c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6fd81170-a863-402a-a0ee-d68d4735e085 tempest-AttachVolumeTestJSON-1408405032 None] Created volume successfully. Jul 25 02:38:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-e3105035-1694-481e-92db-675e93d71e7d req-a93eb487-87a3-49a0-9708-4553492ca58a tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-e3105035-1694-481e-92db-675e93d71e7d req-a93eb487-87a3-49a0-9708-4553492ca58a tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-e3105035-1694-481e-92db-675e93d71e7d req-a93eb487-87a3-49a0-9708-4553492ca58a tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-e3105035-1694-481e-92db-675e93d71e7d req-a93eb487-87a3-49a0-9708-4553492ca58a tempest-AttachVolumeTestJSON-1408405032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de078b4e-1216-4952-bedd-c22dadc39715', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:38:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-e3105035-1694-481e-92db-675e93d71e7d req-a93eb487-87a3-49a0-9708-4553492ca58a tempest-AttachVolumeTestJSON-1408405032 None] attachment_update completed successfully. Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Flow 'volume_create_manager' (f05f2bba-a1bc-43c6-bdae-9d4ddc7da35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fb6767-7cbb-4f6a-8834-39a23dfe726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fb6767-7cbb-4f6a-8834-39a23dfe726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-744895273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7dbf1fc-9013-4928-80dd-f805378e36f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8184c8a328304ba38abf2e70a0b81599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:46Z,use_quota=True,user_id='9fa0602af5e64059ac0cc262a29d2853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17214ce8-b36d-4e26-85a8-e5068c74f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17214ce8-b36d-4e26-85a8-e5068c74f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8445237-773c-4020-a537-dafbcfa5eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8445237-773c-4020-a537-dafbcfa5eae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7dbf1fc-9013-4928-80dd-f805378e36f9', 'volume_name': 'volume-c7dbf1fc-9013-4928-80dd-f805378e36f9', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1ea44-b830-458e-aaf7-4430b1fff66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1ea44-b830-458e-aaf7-4430b1fff66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3da4b3-af65-4c99-a4cf-c58514f44f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Volume c7dbf1fc-9013-4928-80dd-f805378e36f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7dbf1fc-9013-4928-80dd-f805378e36f9', 'volume_size': 1} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-744895273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7dbf1fc-9013-4928-80dd-f805378e36f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8184c8a328304ba38abf2e70a0b81599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:46Z,use_quota=True,user_id='9fa0602af5e64059ac0cc262a29d2853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Creating volume c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:45 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:38:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:45 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 1073741824 Jul 25 02:38:45 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:46 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 1073741824" returned: 0 in 0.729s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:46 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:38:46 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:46 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.334s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3da4b3-af65-4c99-a4cf-c58514f44f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7dbf1fc-9013-4928-80dd-f805378e36f9', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea266a5-6e68-42b9-9c49-4b918a4775bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:46 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Volume volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 (c7dbf1fc-9013-4928-80dd-f805378e36f9): created successfully Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea266a5-6e68-42b9-9c49-4b918a4775bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Flow 'volume_create_manager' (f05f2bba-a1bc-43c6-bdae-9d4ddc7da35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-79e15c64-3e1e-49eb-8f08-4ad61ba25a9e tempest-VolumesActionsTest-1605251250 None] Created volume successfully. Jul 25 02:38:47 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-e545bdce-10d1-4e88-bdc6-35a916b5a27e req-f9c72ccc-ad60-4199-b123-025bc15874d2 tempest-AttachVolumeTestJSON-1408405032 None] Terminate volume connection completed successfully. Jul 25 02:38:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-e545bdce-10d1-4e88-bdc6-35a916b5a27e req-f9c72ccc-ad60-4199-b123-025bc15874d2 tempest-AttachVolumeTestJSON-1408405032 None] Deleting attachment d5777270-2575-4e74-99f8-a3de08f39383. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:38:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-7a80d683-d95d-4895-a0da-78936015b35d req-ea0c1a76-7c1f-453e-91ac-26b83a17819d tempest-AttachVolumeTestJSON-1408405032 None] Terminate volume connection completed successfully. Jul 25 02:38:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-7a80d683-d95d-4895-a0da-78936015b35d req-ea0c1a76-7c1f-453e-91ac-26b83a17819d tempest-AttachVolumeTestJSON-1408405032 None] Deleting attachment de078b4e-1216-4952-bedd-c22dadc39715. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:50 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:38:50 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:51 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.439s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:38:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:38:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:38:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Flow 'volume_create_manager' (7ebe3114-cfcd-44f4-b5ad-612300bc5080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d406b2-2ca9-4d34-91cd-70f2423b57ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d406b2-2ca9-4d34-91cd-70f2423b57ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-683139624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5859c396-f972-40be-9ebe-cb856d93a8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ac5f860fd54186be2b710df4dff894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:53Z,use_quota=True,user_id='5fcfa93f25e64861b54f6c8a52e8b435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d502b06a-05ef-4741-bc50-88c8bbccaf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d502b06a-05ef-4741-bc50-88c8bbccaf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315b10c0-a7a0-4dd1-9c2d-aabc94bdf732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315b10c0-a7a0-4dd1-9c2d-aabc94bdf732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5859c396-f972-40be-9ebe-cb856d93a8fb', 'volume_name': 'volume-5859c396-f972-40be-9ebe-cb856d93a8fb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befcea77-2bc2-4418-bca4-891bf063d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befcea77-2bc2-4418-bca4-891bf063d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74018bda-dd80-4a0a-842f-fc732058b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:53 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Volume 5859c396-f972-40be-9ebe-cb856d93a8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5859c396-f972-40be-9ebe-cb856d93a8fb', 'volume_size': 1} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-683139624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5859c396-f972-40be-9ebe-cb856d93a8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ac5f860fd54186be2b710df4dff894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:53Z,use_quota=True,user_id='5fcfa93f25e64861b54f6c8a52e8b435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Creating volume 5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:53 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:53 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb 1073741824 Jul 25 02:38:53 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:53 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb 1073741824" returned: 0 in 0.771s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:54 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:38:54 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:54 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74018bda-dd80-4a0a-842f-fc732058b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5859c396-f972-40be-9ebe-cb856d93a8fb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45378ce4-e393-4702-a2af-c1ec82ba1417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:54 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Volume volume-5859c396-f972-40be-9ebe-cb856d93a8fb (5859c396-f972-40be-9ebe-cb856d93a8fb): created successfully Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45378ce4-e393-4702-a2af-c1ec82ba1417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Flow 'volume_create_manager' (7ebe3114-cfcd-44f4-b5ad-612300bc5080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-32bd0cb0-67b4-44c8-aed6-9ca78f828844 tempest-SnapshotDependencyTests-984837635 None] Created volume successfully. Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Creating offline snapshot 3d5ff309-b425-45e3-b5f4-03ee14bf420f of volume 5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0af5a7-94ab-4e96-a037-9d361c700135]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:55 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:38:55 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:55 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 0.435s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:55 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f 1G Jul 25 02:38:55 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:56 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f 1G" returned: 0 in 0.565s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5859c396-f972-40be-9ebe-cb856d93a8fb -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:56 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5859c396-f972-40be-9ebe-cb856d93a8fb -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f Jul 25 02:38:56 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:56 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5859c396-f972-40be-9ebe-cb856d93a8fb -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f" returned: 0 in 0.375s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:56 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f is being set with open permissions: ugo+rw Jul 25 02:38:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:56 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f Jul 25 02:38:56 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:57 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f" returned: 0 in 0.312s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:57 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info Jul 25 02:38:57 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:57 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:57 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info is being set with open permissions: ugo+rw Jul 25 02:38:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:57 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info Jul 25 02:38:57 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:57 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 25 02:38:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.info" returned: 0 in 0.243s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:38:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f50824d5-5d02-47f9-9f3c-cf706eb14f35 tempest-SnapshotDependencyTests-984837635 None] Create snapshot completed successfully Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Flow 'volume_create_manager' (a79fca2e-bd1f-4ad5-8391-37b7b977f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98efe8bf-81bd-4e5a-8254-5a854f649165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98efe8bf-81bd-4e5a-8254-5a854f649165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fefe1b-f8ed-4614-beb7-6e9eb74c5177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ac5f860fd54186be2b710df4dff894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d5ff309-b425-45e3-b5f4-03ee14bf420f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:38:59Z,use_quota=True,user_id='5fcfa93f25e64861b54f6c8a52e8b435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8108fb2f-51ec-4e9b-a559-f1a303092ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8108fb2f-51ec-4e9b-a559-f1a303092ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dba4c63-975a-4635-8992-274fc69f2308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dba4c63-975a-4635-8992-274fc69f2308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3fefe1b-f8ed-4614-beb7-6e9eb74c5177', 'volume_name': 'volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177', 'volume_size': 1, 'snapshot_id': '3d5ff309-b425-45e3-b5f4-03ee14bf420f'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ada2d8-6987-4993-a20a-172edd8bc9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ada2d8-6987-4993-a20a-172edd8bc9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccbe5ea-6b59-43cf-ab5a-023b8e34e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:38:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Volume b3fefe1b-f8ed-4614-beb7-6e9eb74c5177: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177', 'volume_size': 1, 'snapshot_id': '3d5ff309-b425-45e3-b5f4-03ee14bf420f'} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-quobyte-3d5ff309-b425-45e3-b5f4-03ee14bf420f-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-3d5ff309-b425-45e3-b5f4-03ee14bf420f-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Creating volume b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 from snapshot 3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-quobyte-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] snapshot: 3d5ff309-b425-45e3-b5f4-03ee14bf420f, volume: b3fefe1b-f8ed-4614-beb7-6e9eb74c5177, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f15e299-b021-4aaf-babc-4ce427fd5f85]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:38:59 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f Jul 25 02:38:59 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "cinder-b7257b86-ba88-4a2b-ab51-2f4164f5f8db-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-b7257b86-ba88-4a2b-ab51-2f4164f5f8db-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "cinder-quobyte-b7257b86-ba88-4a2b-ab51-2f4164f5f8db" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-quobyte-b7257b86-ba88-4a2b-ab51-2f4164f5f8db" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db1490-a07b-408a-998c-934516bc5c13]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:38:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:00 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f" returned: 0 in 0.561s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5859c396-f972-40be-9ebe-cb856d93a8fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:39:00 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db Jul 25 02:39:00 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a7bec-ae87-4ec6-9d06-56ee9ae0cc95]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:00 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:39:00 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:00 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db" returned: 0 in 0.496s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:00 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db Jul 25 02:39:00 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:00 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 0.592s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:00 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 Jul 25 02:39:00 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:00 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7257b86-ba88-4a2b-ab51-2f4164f5f8db" returned: 0 in 0.498s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-quobyte-b7257b86-ba88-4a2b-ab51-2f4164f5f8db" released by "delete_volume" :: held 1.095s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:INSERT=31,cinder:UPDATE=123,cinder:SELECT=102,cinder:DELETE=7 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=116,cinder:INSERT=30,cinder:UPDATE=129,cinder:DELETE=14 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Created reservations ['9d742429-9367-4988-8835-254f26329139', 'aac6e2a5-6e53-4f80-9ab6-a11494038f37', '618138f3-a7d2-405a-b0bc-33d4163648dc', '069d4317-3074-4ab6-a93c-5afa2fc9606f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:01 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:39:01 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:01 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.341s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:39:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Deleted volume successfully. Jul 25 02:39:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-06318cf8-afe8-45b2-8fe5-fcb1797fdab0 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-b7257b86-ba88-4a2b-ab51-2f4164f5f8db-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "cinder-a25d1213-687e-4077-be30-04fd9ee1ffca-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-a25d1213-687e-4077-be30-04fd9ee1ffca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "cinder-quobyte-a25d1213-687e-4077-be30-04fd9ee1ffca" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-quobyte-a25d1213-687e-4077-be30-04fd9ee1ffca" acquired by "delete_volume" :: waited 0.067s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:02 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eaa602-648a-4f31-a5dc-12a9b0efc08d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:03 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca Jul 25 02:39:03 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:03 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca" returned: 0 in 1.195s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:04 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca Jul 25 02:39:04 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:05 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a25d1213-687e-4077-be30-04fd9ee1ffca" returned: 0 in 1.176s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-quobyte-a25d1213-687e-4077-be30-04fd9ee1ffca" released by "delete_volume" :: held 2.507s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Created reservations ['c0182353-73e7-47d4-b6ad-a6f33e9e4d73', '155675fb-a7a0-4164-990d-9bee80803eae', 'f2aa75ed-301b-4c90-857c-2e7fde5b625a', 'd94bad8f-890e-4227-b24e-4cb77d181119'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:05 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:39:05 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:06 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.805s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:06 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:39:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Deleted volume successfully. Jul 25 02:39:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e59f81a-ed76-4c46-b1fa-dc931c17dc36 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-a25d1213-687e-4077-be30-04fd9ee1ffca-delete_volume" released by "delete_volume" :: held 4.321s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "cinder-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "cinder-quobyte-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-quobyte-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[35359b94-9778-44ef-8fd7-869cf465e4bd]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:07 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb Jul 25 02:39:07 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:08 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb" returned: 0 in 0.765s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:08 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb Jul 25 02:39:08 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:09 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb" returned: 0 in 0.946s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-quobyte-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb" released by "delete_volume" :: held 1.895s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:09 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Created reservations ['8afa02d7-0f69-41c3-8d34-50bb53d836ef', '866151e6-1c1e-4546-a5a2-0fb908bce2ae', 'a70a877a-473f-4510-973b-a2d8a98c699f', 'f39b1423-d3dc-403f-899a-1fae05a0f78b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" returned: 0 in 8.713s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8467592-b621-48e8-a811-f41fc8c21174]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:09 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:39:09 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:09 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:39:09 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:10 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-cb62f728-3fdf-473d-8c15-76d8cb6491ef tempest-VolumesActionsTest-1605251250 None] Acquiring lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9" by "attach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.462s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:39:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Deleted volume successfully. Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-cb62f728-3fdf-473d-8c15-76d8cb6491ef tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9" acquired by "attach_volume" :: waited 0.095s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c8b718e8-5321-4cbb-a439-14ad07598481 tempest-AttachVolumeTestJSON-1408405032 None] Lock "cinder-5ff5cf9a-e790-47aa-a3c1-ff059dca3edb-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-cb62f728-3fdf-473d-8c15-76d8cb6491ef tempest-VolumesActionsTest-1605251250 None] Attaching volume c7dbf1fc-9013-4928-80dd-f805378e36f9 to instance fdd012c1-f5fa-4981-8db8-774f5bff3450 at mountpoint /dev/vdb on host None. Jul 25 02:39:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-cb62f728-3fdf-473d-8c15-76d8cb6491ef tempest-VolumesActionsTest-1605251250 None] Attach volume completed successfully. Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-cb62f728-3fdf-473d-8c15-76d8cb6491ef tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9" released by "attach_volume" :: held 0.170s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1db6d3b3-e0b9-4652-9643-2e23e24c090d tempest-VolumesActionsTest-1605251250 None] Acquiring lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-detach_volume" by "detach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1db6d3b3-e0b9-4652-9643-2e23e24c090d tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1db6d3b3-e0b9-4652-9643-2e23e24c090d tempest-VolumesActionsTest-1605251250 None] Detaching volume c7dbf1fc-9013-4928-80dd-f805378e36f9 from instance fdd012c1-f5fa-4981-8db8-774f5bff3450. Jul 25 02:39:10 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 1.163s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:39:10 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Converted 1024.00 MB image at 117.51 MB/s Jul 25 02:39:10 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 is being set with open permissions: ugo+rw Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:10 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 Jul 25 02:39:10 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1db6d3b3-e0b9-4652-9643-2e23e24c090d tempest-VolumesActionsTest-1605251250 None] Detach volume completed successfully. Jul 25 02:39:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1db6d3b3-e0b9-4652-9643-2e23e24c090d tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:11 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" returned: 0 in 0.682s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" released by "_copy_volume_from_snapshot" :: held 11.839s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-3d5ff309-b425-45e3-b5f4-03ee14bf420f-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" released by "_create_volume_from_snapshot" :: held 11.888s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.906s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccbe5ea-6b59-43cf-ab5a-023b8e34e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177', 'volume_size': 1, 'snapshot_id': '3d5ff309-b425-45e3-b5f4-03ee14bf420f'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282c3c96-fb34-4ec2-b65e-252e8e9b833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:11 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Volume volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 (b3fefe1b-f8ed-4614-beb7-6e9eb74c5177): created successfully Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282c3c96-fb34-4ec2-b65e-252e8e9b833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Flow 'volume_create_manager' (a79fca2e-bd1f-4ad5-8391-37b7b977f891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:39:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-be8866df-4872-44e7-b93c-3e19f122fe08 tempest-SnapshotDependencyTests-984837635 None] Created volume successfully. Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-3d5ff309-b425-45e3-b5f4-03ee14bf420f-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-3d5ff309-b425-45e3-b5f4-03ee14bf420f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-quobyte-5859c396-f972-40be-9ebe-cb856d93a8fb" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-5859c396-f972-40be-9ebe-cb856d93a8fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-quobyte-3d5ff309-b425-45e3-b5f4-03ee14bf420f" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-3d5ff309-b425-45e3-b5f4-03ee14bf420f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Deleting offline snapshot 3d5ff309-b425-45e3-b5f4-03ee14bf420f of volume 5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] snapshot_file for this snap is: volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8cff8b-d92a-48c1-a470-d6053115013c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:12 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f Jul 25 02:39:12 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:12 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f" returned: 0 in 0.417s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5859c396-f972-40be-9ebe-cb856d93a8fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:39:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[06983f80-aeab-48eb-b020-54a43ce6d73f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:13 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:39:13 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:13 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 0.440s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:13 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f Jul 25 02:39:13 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:13 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f" returned: 0 in 0.466s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:13 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f Jul 25 02:39:13 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:14 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb.3d5ff309-b425-45e3-b5f4-03ee14bf420f" returned: 0 in 0.373s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-3d5ff309-b425-45e3-b5f4-03ee14bf420f" released by "_delete_snapshot" :: held 1.860s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-5859c396-f972-40be-9ebe-cb856d93a8fb" released by "delete_snapshot" :: held 1.885s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Created reservations ['594e8116-7550-4359-a928-0c2714dbdacf', 'd0f1fdf2-ea89-497a-ad7b-592ee402130e', '07082fc0-4570-43de-ae77-dd799704ab06', 'f680fc64-baf1-44cc-85d8-1597649bfcdc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:39:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Delete snapshot completed successfully. Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ea161c0b-3b8d-4904-86bf-f5edced70782 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-3d5ff309-b425-45e3-b5f4-03ee14bf420f-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-5859c396-f972-40be-9ebe-cb856d93a8fb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-5859c396-f972-40be-9ebe-cb856d93a8fb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-quobyte-5859c396-f972-40be-9ebe-cb856d93a8fb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-5859c396-f972-40be-9ebe-cb856d93a8fb" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a367c-031c-4caf-b398-4463effc32f8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:14 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:39:14 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:15 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 0.529s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:15 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb Jul 25 02:39:15 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:15 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-5859c396-f972-40be-9ebe-cb856d93a8fb" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-5859c396-f972-40be-9ebe-cb856d93a8fb" released by "delete_volume" :: held 0.890s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Created reservations ['b1d96738-fb8a-4f9c-9021-7ff74424a9c7', 'f6922a12-9e8d-447e-83cf-4f157aed5016', 'ab4195ca-e22f-481e-bb72-7ece7b7d7f61', '74b5bc50-d9cd-4d9c-9d2a-908492335798'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:15 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:39:15 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "cinder-quobyte-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d781386c-9a16-42e9-8b24-d95a43d69bf7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:16 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 Jul 25 02:39:16 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:16 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.452s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:39:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Deleted volume successfully. Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2a7f6cad-8797-4dba-845a-2806767a4841 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-5859c396-f972-40be-9ebe-cb856d93a8fb-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:16 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" returned: 0 in 0.462s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:16 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177 Jul 25 02:39:16 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:16 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" returned: 0 in 0.292s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-quobyte-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177" released by "delete_volume" :: held 0.809s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Created reservations ['43d611f8-475b-42b7-b74f-664604f8ebf9', 'ea478b0d-855c-4222-a1e6-a48ccd4d6269', '0686e01e-4af3-4c7f-9384-0720852c3dff', '4b7bb917-600c-4ab3-b898-5729a25d583c'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:16 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:39:16 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:17 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.340s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:17 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:39:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Deleted volume successfully. Jul 25 02:39:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-76a5b373-2a29-477e-aa29-956d91956138 tempest-SnapshotDependencyTests-984837635 None] Lock "cinder-b3fefe1b-f8ed-4614-beb7-6e9eb74c5177-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:26 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=37,cinder:INSERT=10,cinder:UPDATE=54,cinder:DELETE=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:39:27 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=34,cinder:INSERT=16,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Flow 'volume_create_manager' (5ec90ee4-22f1-4aca-8caa-b507cd16e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5bb39b-c80d-4cd5-aa00-e66dab1572e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5bb39b-c80d-4cd5-aa00-e66dab1572e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-835652817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cf16fd-df70-444d-853e-599a73f6681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e8add7c97e46b394f026cd0159b580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:39:33Z,use_quota=True,user_id='08795e8c6f604bd0866c6deebd41c87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c41b80-8ffb-4965-ab4a-144d9f1ef85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c41b80-8ffb-4965-ab4a-144d9f1ef85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ad7626-1edf-4a57-bbfe-2c805a957292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ad7626-1edf-4a57-bbfe-2c805a957292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2cf16fd-df70-444d-853e-599a73f6681e', 'volume_name': 'volume-c2cf16fd-df70-444d-853e-599a73f6681e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af29e2a6-5b8e-4e35-bf7f-674d6b4381a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af29e2a6-5b8e-4e35-bf7f-674d6b4381a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9452ecf6-6ab8-4035-b9f5-8ebd1de967bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:33 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Volume c2cf16fd-df70-444d-853e-599a73f6681e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2cf16fd-df70-444d-853e-599a73f6681e', 'volume_size': 1} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-835652817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cf16fd-df70-444d-853e-599a73f6681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e8add7c97e46b394f026cd0159b580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:39:33Z,use_quota=True,user_id='08795e8c6f604bd0866c6deebd41c87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Creating volume c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:39:33 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:39:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:33 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e 1073741824 Jul 25 02:39:33 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:34 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e 1073741824" returned: 0 in 0.867s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:34 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:39:34 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:34 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 0.461s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9452ecf6-6ab8-4035-b9f5-8ebd1de967bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cf16fd-df70-444d-853e-599a73f6681e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ce6f3f-767e-47cc-accb-2e499f0f55da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:39:34 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Volume volume-c2cf16fd-df70-444d-853e-599a73f6681e (c2cf16fd-df70-444d-853e-599a73f6681e): created successfully Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ce6f3f-767e-47cc-accb-2e499f0f55da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:39:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Flow 'volume_create_manager' (5ec90ee4-22f1-4aca-8caa-b507cd16e87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:39:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c54ef999-e132-45ec-93fb-adf83e6dca93 tempest-TestStampPattern-291827384 None] Created volume successfully. Jul 25 02:39:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-58d6fdb2-1f6c-4dfd-a5ae-5edc5f2aea1e tempest-VolumesActionsTest-1605251250 None] Acquiring lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9" by "attach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-58d6fdb2-1f6c-4dfd-a5ae-5edc5f2aea1e tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9" acquired by "attach_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-58d6fdb2-1f6c-4dfd-a5ae-5edc5f2aea1e tempest-VolumesActionsTest-1605251250 None] Attaching volume c7dbf1fc-9013-4928-80dd-f805378e36f9 to instance 5c4b45e2-42b2-413d-ba76-787e59762682 at mountpoint /dev/vdb on host None. Jul 25 02:39:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-58d6fdb2-1f6c-4dfd-a5ae-5edc5f2aea1e tempest-VolumesActionsTest-1605251250 None] Attach volume completed successfully. Jul 25 02:39:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-58d6fdb2-1f6c-4dfd-a5ae-5edc5f2aea1e tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9" released by "attach_volume" :: held 0.115s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-910823e5-55bb-4d4a-963a-a0c18f470f5a tempest-VolumesActionsTest-1605251250 None] Acquiring lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-detach_volume" by "detach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:39:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-910823e5-55bb-4d4a-963a-a0c18f470f5a tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:39:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-910823e5-55bb-4d4a-963a-a0c18f470f5a tempest-VolumesActionsTest-1605251250 None] Detaching volume c7dbf1fc-9013-4928-80dd-f805378e36f9 from instance 5c4b45e2-42b2-413d-ba76-787e59762682. Jul 25 02:39:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-910823e5-55bb-4d4a-963a-a0c18f470f5a tempest-VolumesActionsTest-1605251250 None] Detach volume completed successfully. Jul 25 02:39:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-910823e5-55bb-4d4a-963a-a0c18f470f5a tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[565129ce-0d3c-4536-ab91-a92d01b58a0a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:46 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:39:46 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:46 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.593s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59e88f5-c6f1-4254-92c4-68f0995931e5]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:47 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:39:47 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:47 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.467s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.971849fc-fadf-4cdb-8e76-1ab9cdc821c9dvgiwq9p.img {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:47 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.971849fc-fadf-4cdb-8e76-1ab9cdc821c9dvgiwq9p.img Jul 25 02:39:47 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:39:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:50 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:39:50 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:51 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.619s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:39:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:39:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:39:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:39:55 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.971849fc-fadf-4cdb-8e76-1ab9cdc821c9dvgiwq9p.img" returned: 0 in 7.724s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f78197-35fd-43cc-b86f-214ba10a3e0d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:39:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:39:55 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:39:55 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:39:55 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 25 02:39:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.618s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:39:55 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.971849fc-fadf-4cdb-8e76-1ab9cdc821c9dvgiwq9p.img {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:39:55 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Converted 1024.00 MB image at 132.51 MB/s Jul 25 02:39:55 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] 971849fc-fadf-4cdb-8e76-1ab9cdc821c9 was raw, no need to convert to raw {{(pid=88279) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 25 02:40:05 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:40:05 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:40:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-8620744c-7f0d-4576-acdc-61b636553726 req-4361b9a6-31b4-4d7e-a90b-4d0744afa19b tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.563s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Uploaded volume to glance image-id: 971849fc-fadf-4cdb-8e76-1ab9cdc821c9. {{(pid=88279) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 25 02:40:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-8620744c-7f0d-4576-acdc-61b636553726 req-4361b9a6-31b4-4d7e-a90b-4d0744afa19b tempest-TestStampPattern-291827384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.379s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-8620744c-7f0d-4576-acdc-61b636553726 req-4361b9a6-31b4-4d7e-a90b-4d0744afa19b tempest-TestStampPattern-291827384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7d6ed9ea-5654-4051-a672-e073aa236295 tempest-VolumesActionsTest-1605251250 None] Copy volume to image completed successfully. Jul 25 02:40:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-8620744c-7f0d-4576-acdc-61b636553726 req-4361b9a6-31b4-4d7e-a90b-4d0744afa19b tempest-TestStampPattern-291827384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-c2cf16fd-df70-444d-853e-599a73f6681e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af27b8e1-c067-41dd-b163-7ee67576e106', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:40:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-8620744c-7f0d-4576-acdc-61b636553726 req-4361b9a6-31b4-4d7e-a90b-4d0744afa19b tempest-TestStampPattern-291827384 None] attachment_update completed successfully. Jul 25 02:40:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf2bdbf-2cd9-4785-b509-08e7eeea2819]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:18 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:40:18 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:18 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.358s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4ce8bd-1e70-417d-ace6-20165a92bd85]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:18 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:40:18 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:18 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.355s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:18 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img Jul 25 02:40:18 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Flow 'volume_create_manager' (2fbfb219-7d23-403f-b313-374d957f8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00626daf-7e76-484f-9e0b-f4fd1bf59fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00626daf-7e76-484f-9e0b-f4fd1bf59fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1970114006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070b9683-f3e3-4392-ac77-77b5d75cef63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea09394cee42db971be4fd19a50c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:21Z,use_quota=True,user_id='33e5f7ee326c4baa9e2b059d677742f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a61706-0143-41f8-8ae3-9d71cc90284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a61706-0143-41f8-8ae3-9d71cc90284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a31179-0aa0-42a1-9124-f21c45c2c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a31179-0aa0-42a1-9124-f21c45c2c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070b9683-f3e3-4392-ac77-77b5d75cef63', 'volume_name': 'volume-070b9683-f3e3-4392-ac77-77b5d75cef63', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f20f61f-fe51-4849-bcb8-977e8519604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f20f61f-fe51-4849-bcb8-977e8519604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2d44bd-a15c-48b2-bc54-73b1a6b5f50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Volume 070b9683-f3e3-4392-ac77-77b5d75cef63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070b9683-f3e3-4392-ac77-77b5d75cef63', 'volume_size': 1} Jul 25 02:40:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:23 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img" returned: 0 in 4.975s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfa54ad-8fa0-4858-8034-82515683fc6b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:23 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:40:23 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:24 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-769ac7ef-a170-4164-8e8e-01ea8c66944e req-bd99c7a7-586b-4c7f-9d77-346632eb7737 tempest-TestStampPattern-291827384 None] Terminate volume connection completed successfully. Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-769ac7ef-a170-4164-8e8e-01ea8c66944e req-bd99c7a7-586b-4c7f-9d77-346632eb7737 tempest-TestStampPattern-291827384 None] Deleting attachment af27b8e1-c067-41dd-b163-7ee67576e106. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:40:24 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.573s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:40:24 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Converted 1024.00 MB image at 205.81 MB/s Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] bbb1d528-e673-4c92-8029-d1194dd794da was raw, converting to qcow2 {{(pid=88279) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9f70e-9967-4729-ba98-0bf5f7454351]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:24 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img Jul 25 02:40:24 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:24 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img" returned: 0 in 0.394s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:24 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img Jul 25 02:40:24 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:24 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img" returned: 1 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:40:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:25 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy Jul 25 02:40:25 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:25 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy" returned: 0 in 0.302s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:25 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Image conversion details: src /opt/stack/data/cinder/conversion/c7dbf1fc-9013-4928-80dd-f805378e36f9.temp_image.bbb1d528-e673-4c92-8029-d1194dd794day9853r9m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:40:25 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 25 02:40:25 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2fba0-eda8-4338-ae4e-c395d292f938]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:25 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy Jul 25 02:40:25 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:25 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_s3o4wfzy" returned: 0 in 0.346s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.970s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Uploaded volume to glance image-id: bbb1d528-e673-4c92-8029-d1194dd794da. {{(pid=88279) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.427s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1970114006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070b9683-f3e3-4392-ac77-77b5d75cef63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea09394cee42db971be4fd19a50c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:21Z,use_quota=True,user_id='33e5f7ee326c4baa9e2b059d677742f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Creating volume 070b9683-f3e3-4392-ac77-77b5d75cef63 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:40:26 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:40:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:26 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 1073741824 Jul 25 02:40:26 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a14ab288-c351-4ad1-b43c-a36fc700cd58 tempest-VolumesActionsTest-1605251250 None] Copy volume to image completed successfully. Jul 25 02:40:27 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 1073741824" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:27 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 Jul 25 02:40:27 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:27 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.473s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Creating offline snapshot d6272f11-c380-4b28-b6ee-af700ac21cfe of volume c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2d44bd-a15c-48b2-bc54-73b1a6b5f50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070b9683-f3e3-4392-ac77-77b5d75cef63', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d462b1-7b78-40b5-9029-ea6a246dad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc52cfa9-8151-40ed-bc88-a9b29a69f5db]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Volume volume-070b9683-f3e3-4392-ac77-77b5d75cef63 (070b9683-f3e3-4392-ac77-77b5d75cef63): created successfully Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d462b1-7b78-40b5-9029-ea6a246dad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Flow 'volume_create_manager' (2fbfb219-7d23-403f-b313-374d957f8471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2050d8a0-6e63-4d3d-b904-3049d3a84b73 tempest-AttachVolumeNegativeTest-1300142540 None] Created volume successfully. Jul 25 02:40:27 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:40:27 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:28 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 0.387s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:28 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe 1G Jul 25 02:40:28 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Acquiring lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Acquiring lock "cinder-quobyte-c7dbf1fc-9013-4928-80dd-f805378e36f9" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Lock "cinder-quobyte-c7dbf1fc-9013-4928-80dd-f805378e36f9" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24be797-f144-430e-a722-f6498856dee2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:28 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:40:28 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:28 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe 1G" returned: 0 in 0.474s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2cf16fd-df70-444d-853e-599a73f6681e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:28 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2cf16fd-df70-444d-853e-599a73f6681e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe Jul 25 02:40:28 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:28 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.443s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:28 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9 Jul 25 02:40:28 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:28 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2cf16fd-df70-444d-853e-599a73f6681e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe" returned: 0 in 0.353s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:28 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe is being set with open permissions: ugo+rw Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:28 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe Jul 25 02:40:28 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:28 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c7dbf1fc-9013-4928-80dd-f805378e36f9" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Lock "cinder-quobyte-c7dbf1fc-9013-4928-80dd-f805378e36f9" released by "delete_volume" :: held 0.774s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Created reservations ['8e213859-bd26-4fd6-aaf8-5ec1f909b510', '9bc0f527-060f-46dc-b97c-fe51502279a5', 'adda5afa-d989-4808-b43b-c2de9bb93544', '65237652-cd1a-4fae-99c1-e03b008583ce'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:29 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:29 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:40:29 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3711a64b-4b6a-4b83-9f8e-529effe892b3 req-5a62a1aa-a5df-4ba4-b713-0ccdaf4e4af8 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:29 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info Jul 25 02:40:29 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:29 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.286s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:40:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Deleted volume successfully. Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bdc6fd3f-dd3b-4a15-9a1f-b8fb27a63e3e tempest-VolumesActionsTest-1605251250 None] Lock "cinder-c7dbf1fc-9013-4928-80dd-f805378e36f9-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:29 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:29 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info is being set with open permissions: ugo+rw Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:29 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info Jul 25 02:40:29 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:29 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.info" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3711a64b-4b6a-4b83-9f8e-529effe892b3 req-5a62a1aa-a5df-4ba4-b713-0ccdaf4e4af8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.594s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3711a64b-4b6a-4b83-9f8e-529effe892b3 req-5a62a1aa-a5df-4ba4-b713-0ccdaf4e4af8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-86a5ce99-620c-474c-b7d5-b47f23cbda44 tempest-TestStampPattern-291827384 None] Create snapshot completed successfully Jul 25 02:40:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-3711a64b-4b6a-4b83-9f8e-529effe892b3 req-5a62a1aa-a5df-4ba4-b713-0ccdaf4e4af8 tempest-AttachVolumeNegativeTest-1300142540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-070b9683-f3e3-4392-ac77-77b5d75cef63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f8138d8-40ed-4d37-95fd-a054a16d1da0', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:40:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-3711a64b-4b6a-4b83-9f8e-529effe892b3 req-5a62a1aa-a5df-4ba4-b713-0ccdaf4e4af8 tempest-AttachVolumeNegativeTest-1300142540 None] attachment_update completed successfully. Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Flow 'volume_create_manager' (5031d214-0461-4380-b6e2-2664515faa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d67a0a-f9c1-45a0-bf6e-8bc7bd51753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d67a0a-f9c1-45a0-bf6e-8bc7bd51753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-767811830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c047399-d2e2-4eee-9d93-fa0778fd59e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f62bf8682e143d59dcd1b81ccbc04c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:36Z,use_quota=True,user_id='44cab26c75de49fcb3203f6745b1550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e47c57f-7b1b-46f9-bd93-09adea835c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e47c57f-7b1b-46f9-bd93-09adea835c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eddd416c-cf7e-4c00-aaf8-d0c6b4af8c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eddd416c-cf7e-4c00-aaf8-d0c6b4af8c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c047399-d2e2-4eee-9d93-fa0778fd59e9', 'volume_name': 'volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9', 'volume_size': 2}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a53574-e6b0-42ae-baf3-3abb71cda25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a53574-e6b0-42ae-baf3-3abb71cda25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010142dc-3411-476e-a127-5d64134b5a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:36 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Volume 9c047399-d2e2-4eee-9d93-fa0778fd59e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9', 'volume_size': 2} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-767811830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c047399-d2e2-4eee-9d93-fa0778fd59e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f62bf8682e143d59dcd1b81ccbc04c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:36Z,use_quota=True,user_id='44cab26c75de49fcb3203f6745b1550c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Creating volume 9c047399-d2e2-4eee-9d93-fa0778fd59e9 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:40:36 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:40:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 2147483648 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:36 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 2147483648 Jul 25 02:40:36 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:37 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 2147483648" returned: 0 in 0.780s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:37 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 Jul 25 02:40:37 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:37 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010142dc-3411-476e-a127-5d64134b5a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9', 'volume_size': 2}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71138447-c27e-4ed5-84b1-623dadb4dd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:37 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Volume volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 (9c047399-d2e2-4eee-9d93-fa0778fd59e9): created successfully Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71138447-c27e-4ed5-84b1-623dadb4dd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:37 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Flow 'volume_create_manager' (5031d214-0461-4380-b6e2-2664515faa71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:37 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7f5fb916-f3ff-4020-8bfa-0cde392eb5d7 tempest-VolumesCloneNegativeTest-551137875 None] Created volume successfully. Jul 25 02:40:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Acquiring lock "cinder-9c047399-d2e2-4eee-9d93-fa0778fd59e9-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Lock "cinder-9c047399-d2e2-4eee-9d93-fa0778fd59e9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Acquiring lock "cinder-quobyte-9c047399-d2e2-4eee-9d93-fa0778fd59e9" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Lock "cinder-quobyte-9c047399-d2e2-4eee-9d93-fa0778fd59e9" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[704c8ad0-8cb0-462b-9eba-a32a8285f4a2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:39 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 Jul 25 02:40:39 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:39 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9" returned: 0 in 0.449s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:39 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9 Jul 25 02:40:39 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:39 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c047399-d2e2-4eee-9d93-fa0778fd59e9" returned: 0 in 0.299s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Lock "cinder-quobyte-9c047399-d2e2-4eee-9d93-fa0778fd59e9" released by "delete_volume" :: held 0.823s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Flow 'volume_create_manager' (8dd57843-fc34-480f-b711-5e10db34f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890e582d-2202-42d7-bdd6-b57093ff9fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890e582d-2202-42d7-bdd6-b57093ff9fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1001807841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006a2178-ac84-460a-b951-5fd46a608b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e8add7c97e46b394f026cd0159b580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6272f11-c380-4b28-b6ee-af700ac21cfe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:40Z,use_quota=True,user_id='08795e8c6f604bd0866c6deebd41c87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34b58fd-5f9e-48d7-b377-f2fc329bfa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34b58fd-5f9e-48d7-b377-f2fc329bfa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bab9828-a43c-4bfe-b1fe-44e3e0ec631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bab9828-a43c-4bfe-b1fe-44e3e0ec631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '006a2178-ac84-460a-b951-5fd46a608b11', 'volume_name': 'volume-006a2178-ac84-460a-b951-5fd46a608b11', 'volume_size': 1, 'snapshot_id': 'd6272f11-c380-4b28-b6ee-af700ac21cfe'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e62172-5019-417e-a22c-1f6aa385351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e62172-5019-417e-a22c-1f6aa385351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12cd9de-2a3e-4e71-9f1f-b41f7d6ecc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:40 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Volume 006a2178-ac84-460a-b951-5fd46a608b11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-006a2178-ac84-460a-b951-5fd46a608b11', 'volume_size': 1, 'snapshot_id': 'd6272f11-c380-4b28-b6ee-af700ac21cfe'} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-quobyte-d6272f11-c380-4b28-b6ee-af700ac21cfe-006a2178-ac84-460a-b951-5fd46a608b11" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Created reservations ['26a7e231-fa24-43e3-ab91-d1424bfeee2d', '0db78b37-9a27-45db-b7dc-e6814147b2b7', '2451ba54-80d0-434d-8027-edaf251a7705', '250f6da4-91ad-4f86-af5b-a07d9c22bd46'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-d6272f11-c380-4b28-b6ee-af700ac21cfe-006a2178-ac84-460a-b951-5fd46a608b11" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Creating volume 006a2178-ac84-460a-b951-5fd46a608b11 from snapshot d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-quobyte-006a2178-ac84-460a-b951-5fd46a608b11" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-006a2178-ac84-460a-b951-5fd46a608b11" acquired by "_copy_volume_from_snapshot" :: waited 0.075s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] snapshot: d6272f11-c380-4b28-b6ee-af700ac21cfe, volume: 006a2178-ac84-460a-b951-5fd46a608b11, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24c6c71-f46b-4481-9454-d11b1f6869f3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:40 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe Jul 25 02:40:40 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:40 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:40:40 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:40 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.352s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:40:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Deleted volume successfully. Jul 25 02:40:40 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe" returned: 0 in 0.503s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2cf16fd-df70-444d-853e-599a73f6681e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a0641478-42d3-420f-bc5b-f0a8e4f0fec9 tempest-VolumesCloneNegativeTest-551137875 None] Lock "cinder-9c047399-d2e2-4eee-9d93-fa0778fd59e9-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97da82a-5810-408b-8bb2-3f98bfbee039]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:41 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:40:41 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:41 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 0.490s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:41 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:40:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:41 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 Jul 25 02:40:41 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:50 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11" returned: 0 in 8.802s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea57eb98-fe98-4075-a50e-fcf70f302a28]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:50 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:40:50 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=32,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=41,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=3 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:40:50 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:40:50 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:51 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 1.155s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e, size 1024.00 MB, duration 8.80 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:40:51 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Converted 1024.00 MB image at 116.32 MB/s Jul 25 02:40:51 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 is being set with open permissions: ugo+rw Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:51 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 Jul 25 02:40:51 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:51 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.726s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (230d8de1-ed77-4800-9be9-21cf46aa6a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8389a163-ef21-41bc-aba9-7d50f47d0a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8389a163-ef21-41bc-aba9-7d50f47d0a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-57597137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a08b332-14da-47dd-8822-54e540280653,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:51Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c9f4e1-ea7b-4abc-946a-07bde181ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c9f4e1-ea7b-4abc-946a-07bde181ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c355611f-d6c3-4f82-abf9-7fb3b5b45055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c355611f-d6c3-4f82-abf9-7fb3b5b45055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a08b332-14da-47dd-8822-54e540280653', 'volume_name': 'volume-3a08b332-14da-47dd-8822-54e540280653', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1d7a49-a1ed-4b18-bffa-e4a25e84c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1d7a49-a1ed-4b18-bffa-e4a25e84c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dda09d-a722-4dea-adc3-5b2ed77c69ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:51 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Volume 3a08b332-14da-47dd-8822-54e540280653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a08b332-14da-47dd-8822-54e540280653', 'volume_size': 1} Jul 25 02:40:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:52 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11" returned: 0 in 0.651s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-006a2178-ac84-460a-b951-5fd46a608b11" released by "_copy_volume_from_snapshot" :: held 11.822s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-d6272f11-c380-4b28-b6ee-af700ac21cfe-006a2178-ac84-460a-b951-5fd46a608b11" released by "_create_volume_from_snapshot" :: held 11.941s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.986s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-57597137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a08b332-14da-47dd-8822-54e540280653,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:51Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Creating volume 3a08b332-14da-47dd-8822-54e540280653 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:40:52 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:52 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 1073741824 Jul 25 02:40:52 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12cd9de-2a3e-4e71-9f1f-b41f7d6ecc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006a2178-ac84-460a-b951-5fd46a608b11', 'volume_size': 1, 'snapshot_id': 'd6272f11-c380-4b28-b6ee-af700ac21cfe'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fca174e-ec61-43bc-8483-1aaea77bc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:52 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Volume volume-006a2178-ac84-460a-b951-5fd46a608b11 (006a2178-ac84-460a-b951-5fd46a608b11): created successfully Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fca174e-ec61-43bc-8483-1aaea77bc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Flow 'volume_create_manager' (8dd57843-fc34-480f-b711-5e10db34f805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e779ed00-ea87-436d-b75a-75d4cdcf9837 tempest-TestStampPattern-291827384 None] Created volume successfully. Jul 25 02:40:52 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 1073741824" returned: 0 in 0.742s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:52 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 Jul 25 02:40:52 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:53 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653" returned: 0 in 0.367s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dda09d-a722-4dea-adc3-5b2ed77c69ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a08b332-14da-47dd-8822-54e540280653', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0d97df-14ee-4cd5-bd19-dd0d62c40509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:53 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Volume volume-3a08b332-14da-47dd-8822-54e540280653 (3a08b332-14da-47dd-8822-54e540280653): created successfully Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0d97df-14ee-4cd5-bd19-dd0d62c40509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (230d8de1-ed77-4800-9be9-21cf46aa6a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:53 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-95a4715a-1866-479f-8153-87abf2d43106 tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (dadf07d7-cdc3-4af1-8214-9f5a086d3434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6036547b-2754-470c-97ec-2da1503bd850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6036547b-2754-470c-97ec-2da1503bd850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1546080198',display_name='tempest-VolumesGetTest-Volume-743113985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcdb5d4-0427-491a-aa83-ccd31fd67aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:55Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b65f40-b84d-4060-b35f-cc52ebb9e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b65f40-b84d-4060-b35f-cc52ebb9e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f23807e-f219-4b05-b42e-0c616e976fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f23807e-f219-4b05-b42e-0c616e976fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcdb5d4-0427-491a-aa83-ccd31fd67aa2', 'volume_name': 'volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c0bde3-c146-457b-9e0c-ac15fa121669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c0bde3-c146-457b-9e0c-ac15fa121669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8604110-c90e-4a22-bd88-c6a3f4c6d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Volume 3dcdb5d4-0427-491a-aa83-ccd31fd67aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2', 'volume_size': 1} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:40:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1546080198',display_name='tempest-VolumesGetTest-Volume-743113985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcdb5d4-0427-491a-aa83-ccd31fd67aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:40:55Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Creating volume 3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:40:55 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:55 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 1073741824 Jul 25 02:40:55 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:55 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 1073741824" returned: 0 in 0.450s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:55 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 Jul 25 02:40:55 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:55 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8604110-c90e-4a22-bd88-c6a3f4c6d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2004fc8-b457-4e16-bffa-729a1a1bbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:40:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Volume volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 (3dcdb5d4-0427-491a-aa83-ccd31fd67aa2): created successfully Jul 25 02:40:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2004fc8-b457-4e16-bffa-729a1a1bbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:40:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (dadf07d7-cdc3-4af1-8214-9f5a086d3434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:40:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-161a2e07-1373-4036-95d8-cca1ee21f065 tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Lock "cinder-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f643753-31a5-4c76-aa2d-89517ebab457]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:57 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 Jul 25 02:40:57 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:57 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2" returned: 0 in 0.382s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:57 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2 Jul 25 02:40:57 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:57 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2" released by "delete_volume" :: held 0.692s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:57 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Created reservations ['4aa8cfa6-2f4f-455e-85d0-ef22eb7437a3', '6376fb73-2d97-4688-b997-faad4331e387', 'f7258f5d-4a88-4223-aa97-d9775037b79e', '3d6d33c1-3a6c-4457-aa95-9104be5021a9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:58 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:40:58 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:58 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.311s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:40:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f9adf8d5-577e-48be-b746-5ed680789416 tempest-VolumesGetTest-1264959713 None] Lock "cinder-3dcdb5d4-0427-491a-aa83-ccd31fd67aa2-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-3a08b332-14da-47dd-8822-54e540280653-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Lock "cinder-3a08b332-14da-47dd-8822-54e540280653-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-3a08b332-14da-47dd-8822-54e540280653" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-3a08b332-14da-47dd-8822-54e540280653" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee887501-6b7a-480e-b08d-0ae97eef7ae4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:40:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:58 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 Jul 25 02:40:58 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:59 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653" returned: 0 in 0.455s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:59 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653 Jul 25 02:40:59 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:59 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3a08b332-14da-47dd-8822-54e540280653" returned: 0 in 0.299s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-3a08b332-14da-47dd-8822-54e540280653" released by "delete_volume" :: held 0.814s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Created reservations ['66b30321-64d2-4530-8231-b710dc251cad', '8ad328b8-1355-473c-a6a5-631b9829d068', '2b408e07-cf34-44d1-851a-f1930b5de32d', 'e72ae811-3fc0-46ec-914d-cd9dbdd63e45'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:40:59 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:40:59 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:40:59 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:40:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:40:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3830eeca-c203-428d-bc33-609b0cc3cf76 tempest-VolumesGetTest-1264959713 None] Lock "cinder-3a08b332-14da-47dd-8822-54e540280653-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (edf2ca61-4c2a-4ed9-ae4e-53015fb02165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85222fcd-6637-4791-a5f2-009af95e1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85222fcd-6637-4791-a5f2-009af95e1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1676082040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bdcef0-51b1-4bce-abdc-927f1780081c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:00Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564de50e-d9d5-4cfc-a6ef-722adee92f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564de50e-d9d5-4cfc-a6ef-722adee92f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d432060-f579-4adf-ace8-6155401088b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d432060-f579-4adf-ace8-6155401088b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bdcef0-51b1-4bce-abdc-927f1780081c', 'volume_name': 'volume-76bdcef0-51b1-4bce-abdc-927f1780081c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ccb1d9-9a52-4e52-8b9e-4d0f0862839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ccb1d9-9a52-4e52-8b9e-4d0f0862839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d7e16f-bc3c-403d-96c2-42679bdafc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Volume 76bdcef0-51b1-4bce-abdc-927f1780081c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bdcef0-51b1-4bce-abdc-927f1780081c', 'volume_size': 1} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1676082040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bdcef0-51b1-4bce-abdc-927f1780081c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:00Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Creating volume 76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:41:00 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:00 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c 1073741824 Jul 25 02:41:00 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:00 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c 1073741824" returned: 0 in 0.458s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:00 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:00 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:01 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d7e16f-bc3c-403d-96c2-42679bdafc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bdcef0-51b1-4bce-abdc-927f1780081c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6c1179-dfdc-4b23-b67d-ea83dbb1af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Volume volume-76bdcef0-51b1-4bce-abdc-927f1780081c (76bdcef0-51b1-4bce-abdc-927f1780081c): created successfully Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6c1179-dfdc-4b23-b67d-ea83dbb1af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (edf2ca61-4c2a-4ed9-ae4e-53015fb02165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f3dc73c5-59be-4ca5-983a-cb1c9dfc2b34 tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (9f352ffe-d245-472b-b5bd-9a4ffcb8f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7be71-5bd9-4cde-9164-22f578ad0866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7be71-5bd9-4cde-9164-22f578ad0866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-80546006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e80925d-3b10-4744-9d99-1e040a0a18ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=76bdcef0-51b1-4bce-abdc-927f1780081c,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:03Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2f9352-6760-43ef-8b99-f379f9e35321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2f9352-6760-43ef-8b99-f379f9e35321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc88e53-c10f-433e-854c-468585f00311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc88e53-c10f-433e-854c-468585f00311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0e80925d-3b10-4744-9d99-1e040a0a18ca', 'volume_name': 'volume-0e80925d-3b10-4744-9d99-1e040a0a18ca', 'volume_size': 1, 'source_volid': '76bdcef0-51b1-4bce-abdc-927f1780081c', 'source_volstatus': 'available'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724fbe5f-9616-4ac1-b6fc-b9f3134636d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724fbe5f-9616-4ac1-b6fc-b9f3134636d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7d6db5-aa17-4e07-b376-39e821095836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Volume 0e80925d-3b10-4744-9d99-1e040a0a18ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0e80925d-3b10-4744-9d99-1e040a0a18ca', 'volume_size': 1, 'source_volid': '76bdcef0-51b1-4bce-abdc-927f1780081c', 'source_volstatus': 'available'} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:03 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Cloning volume 76bdcef0-51b1-4bce-abdc-927f1780081c to volume 0e80925d-3b10-4744-9d99-1e040a0a18ca Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Creating offline snapshot daf12bd2-1563-415f-ab29-8289a75df09f of volume 76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f0c504-098d-4ba1-8ee0-d8f60449b885]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:03 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:03 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:03 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.422s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:03 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f 1G Jul 25 02:41:03 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:03 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f 1G" returned: 0 in 0.473s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bdcef0-51b1-4bce-abdc-927f1780081c -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:04 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bdcef0-51b1-4bce-abdc-927f1780081c -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f Jul 25 02:41:04 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:04 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bdcef0-51b1-4bce-abdc-927f1780081c -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f" returned: 0 in 0.298s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:04 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f is being set with open permissions: ugo+rw Jul 25 02:41:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:04 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f Jul 25 02:41:04 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:04 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:04 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info Jul 25 02:41:04 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:04 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:04 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info is being set with open permissions: ugo+rw Jul 25 02:41:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:04 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info Jul 25 02:41:04 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:05 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.info" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-0e80925d-3b10-4744-9d99-1e040a0a18ca" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-0e80925d-3b10-4744-9d99-1e040a0a18ca" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] snapshot: daf12bd2-1563-415f-ab29-8289a75df09f, volume: 0e80925d-3b10-4744-9d99-1e040a0a18ca, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d6a34-6a28-48cb-baad-7641a19f1706]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:05 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f Jul 25 02:41:05 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:05 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76bdcef0-51b1-4bce-abdc-927f1780081c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3633a-0cc1-4d27-9217-06c8fec30187]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:05 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:05 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:06 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.470s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:06 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:41:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:06 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca Jul 25 02:41:06 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:11 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca" returned: 0 in 5.837s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fa415-5b7c-4b2e-b089-69473f18f325]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:12 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:12 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:12 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.538s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:41:12 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Converted 1024.00 MB image at 175.41 MB/s Jul 25 02:41:12 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca is being set with open permissions: ugo+rw Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:12 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca Jul 25 02:41:12 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:12 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca" returned: 0 in 0.270s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-0e80925d-3b10-4744-9d99-1e040a0a18ca" released by "_copy_volume_from_snapshot" :: held 7.590s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-daf12bd2-1563-415f-ab29-8289a75df09f" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-daf12bd2-1563-415f-ab29-8289a75df09f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Deleting offline snapshot daf12bd2-1563-415f-ab29-8289a75df09f of volume 76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] snapshot_file for this snap is: volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c1a72-2d5d-4f71-8e5e-b4acc69eb0cc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:12 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f Jul 25 02:41:12 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:13 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76bdcef0-51b1-4bce-abdc-927f1780081c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9fbf6-f6b9-4446-ba85-9473f5e7e031]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:13 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:13 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:13 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.398s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:13 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f Jul 25 02:41:13 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:13 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f" returned: 0 in 0.326s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:13 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f Jul 25 02:41:13 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-1db1cf9d-58a1-4cbc-a44e-5639f582d775 req-0911354a-36de-41cb-bbb8-a442d91fa4ac tempest-AttachVolumeNegativeTest-1300142540 None] Terminate volume connection completed successfully. Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-1db1cf9d-58a1-4cbc-a44e-5639f582d775 req-0911354a-36de-41cb-bbb8-a442d91fa4ac tempest-AttachVolumeNegativeTest-1300142540 None] Deleting attachment 6f8138d8-40ed-4d37-95fd-a054a16d1da0. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:41:14 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c.daf12bd2-1563-415f-ab29-8289a75df09f" returned: 0 in 0.274s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-daf12bd2-1563-415f-ab29-8289a75df09f" released by "_delete_snapshot" :: held 1.485s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.235s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7d6db5-aa17-4e07-b376-39e821095836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e80925d-3b10-4744-9d99-1e040a0a18ca', 'volume_size': 1, 'source_volid': '76bdcef0-51b1-4bce-abdc-927f1780081c', 'source_volstatus': 'available'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba307b2-c411-42f6-9791-71d501c88e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:14 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Volume volume-0e80925d-3b10-4744-9d99-1e040a0a18ca (0e80925d-3b10-4744-9d99-1e040a0a18ca): created successfully Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba307b2-c411-42f6-9791-71d501c88e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (9f352ffe-d245-472b-b5bd-9a4ffcb8f808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0d32a0d4-29da-443d-8a26-69f8415b361e tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (72ac6c59-4cf5-44e0-823e-a050b91eaad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993503b2-928f-4210-a736-86f190c742f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993503b2-928f-4210-a736-86f190c742f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1064055855',display_name='tempest-VolumesGetTest-Volume-1511435956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418922d3-c64f-46df-b44f-8f9c094dc65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:16Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe03fec7-57fc-494c-abfa-55c9db48a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe03fec7-57fc-494c-abfa-55c9db48a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38a46a7-4960-444c-88b0-cbdce3cdfb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38a46a7-4960-444c-88b0-cbdce3cdfb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418922d3-c64f-46df-b44f-8f9c094dc65c', 'volume_name': 'volume-418922d3-c64f-46df-b44f-8f9c094dc65c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cdad3c-3067-4aa0-a628-fda255201058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cdad3c-3067-4aa0-a628-fda255201058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4cc348-3a21-4e53-83d8-c7e409abf5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:16 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Volume 418922d3-c64f-46df-b44f-8f9c094dc65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418922d3-c64f-46df-b44f-8f9c094dc65c', 'volume_size': 1} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1064055855',display_name='tempest-VolumesGetTest-Volume-1511435956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418922d3-c64f-46df-b44f-8f9c094dc65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:16Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Creating volume 418922d3-c64f-46df-b44f-8f9c094dc65c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:41:16 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:16 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c 1073741824 Jul 25 02:41:16 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:16 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c 1073741824" returned: 0 in 0.477s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:16 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c Jul 25 02:41:16 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:16 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c" returned: 0 in 0.260s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4cc348-3a21-4e53-83d8-c7e409abf5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418922d3-c64f-46df-b44f-8f9c094dc65c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bca5a3f-f02a-4ad8-92a3-2e732775c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:16 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Volume volume-418922d3-c64f-46df-b44f-8f9c094dc65c (418922d3-c64f-46df-b44f-8f9c094dc65c): created successfully Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bca5a3f-f02a-4ad8-92a3-2e732775c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (72ac6c59-4cf5-44e0-823e-a050b91eaad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5aaee6b1-ff3f-4141-acb6-ef009c4f4708 tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-418922d3-c64f-46df-b44f-8f9c094dc65c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Lock "cinder-418922d3-c64f-46df-b44f-8f9c094dc65c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-418922d3-c64f-46df-b44f-8f9c094dc65c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-418922d3-c64f-46df-b44f-8f9c094dc65c" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6676bb-7045-447a-8a2a-b8c6165fde19]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:18 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c Jul 25 02:41:18 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:18 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:18 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c Jul 25 02:41:18 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:18 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-418922d3-c64f-46df-b44f-8f9c094dc65c" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-418922d3-c64f-46df-b44f-8f9c094dc65c" released by "delete_volume" :: held 0.671s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Created reservations ['6bd05fbc-f19d-4ac0-a582-cb11684ab7d5', '1a172d28-681c-4447-9222-b65175ee9b95', 'c32c8c8f-1d12-47a6-9db6-b7846546d2c1', 'fc9333a6-b260-477b-aafd-33b9ed5bb1e6'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:19 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:19 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:19 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bae9618-9a5a-4430-9869-c98288509b91 tempest-VolumesGetTest-1264959713 None] Lock "cinder-418922d3-c64f-46df-b44f-8f9c094dc65c-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-0e80925d-3b10-4744-9d99-1e040a0a18ca-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Lock "cinder-0e80925d-3b10-4744-9d99-1e040a0a18ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-0e80925d-3b10-4744-9d99-1e040a0a18ca" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-0e80925d-3b10-4744-9d99-1e040a0a18ca" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1bad2-a8f5-409a-aeb9-9c7489f49a21]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:19 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca Jul 25 02:41:19 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:19 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca" returned: 0 in 0.386s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:20 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca Jul 25 02:41:20 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:20 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0e80925d-3b10-4744-9d99-1e040a0a18ca" returned: 0 in 0.307s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-0e80925d-3b10-4744-9d99-1e040a0a18ca" released by "delete_volume" :: held 0.733s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Created reservations ['b5002073-88dd-4d4a-b78a-27eaaa68fee6', '969b0113-0153-4819-9081-aaaa5eb6153f', '15822e54-6479-4947-98cf-c52486741943', '41c2e6ca-2b4e-4729-bf2e-38add5d13a3c'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:20 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:20 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:20 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.289s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-76bdcef0-51b1-4bce-abdc-927f1780081c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Lock "cinder-76bdcef0-51b1-4bce-abdc-927f1780081c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-debb8a45-fa0a-4825-8fe1-f63d8541e388 tempest-VolumesGetTest-1264959713 None] Lock "cinder-0e80925d-3b10-4744-9d99-1e040a0a18ca-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-76bdcef0-51b1-4bce-abdc-927f1780081c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-76bdcef0-51b1-4bce-abdc-927f1780081c" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135098d-a4f3-4868-813b-1d3b2a3b7f9a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:21 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:21 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:21 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.479s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:21 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c Jul 25 02:41:21 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:21 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76bdcef0-51b1-4bce-abdc-927f1780081c" returned: 0 in 0.289s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-76bdcef0-51b1-4bce-abdc-927f1780081c" released by "delete_volume" :: held 0.849s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Created reservations ['2b375ad8-ad94-42a7-a3b7-048bb3bf230c', '5f8d1636-e0e2-4f6c-bc91-517ee22c2948', '2d8bf087-1f03-49f0-8abb-7cfc63abd28a', 'd0c152c7-1d6b-4da3-944f-55c175b18049'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:21 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:21 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:22 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.378s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:22 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:41:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-34b3b9e0-3e44-49e0-b238-a1f30c600f95 tempest-VolumesGetTest-1264959713 None] Lock "cinder-76bdcef0-51b1-4bce-abdc-927f1780081c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (d4cb08f7-e855-42fa-8fa2-0a61b08f896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c145c3ab-7788-4f3f-a9ee-7e21926d60e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c145c3ab-7788-4f3f-a9ee-7e21926d60e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1684293058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efc781b-87fa-48b5-9f4d-64ee3871f28b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:23Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8542c-ba23-4fc1-a6e1-f5e4981ec8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8542c-ba23-4fc1-a6e1-f5e4981ec8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93421fa9-06c8-4645-8140-9f9e30fe802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93421fa9-06c8-4645-8140-9f9e30fe802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0efc781b-87fa-48b5-9f4d-64ee3871f28b', 'volume_name': 'volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4951b63-b812-4d50-ada0-c86c791c3b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4951b63-b812-4d50-ada0-c86c791c3b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12ec6e3-c1f6-4d6d-bfbd-214c16afca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:23 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Volume 0efc781b-87fa-48b5-9f4d-64ee3871f28b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Trying to clone 0efc781b-87fa-48b5-9f4d-64ee3871f28b from image 19c99a4c-891e-4766-a74f-7e24d755618e at location (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:41:23 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:41:23 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Image download 20.69 MB at 20.69 MB/s Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b575a891-ea24-436a-90de-ec0ecfa285b0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:24 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD Jul 25 02:41:24 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:24 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e is fetched for user 029d3ce59c2049d6b637035c6b873874. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d6a350-eb76-4ef4-baf7-7b6122af6745]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:24 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD Jul 25 02:41:24 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:24 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1684293058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efc781b-87fa-48b5-9f4d-64ee3871f28b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:23Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Creating volume 0efc781b-87fa-48b5-9f4d-64ee3871f28b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:41:24 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:41:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:24 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b 1073741824 Jul 25 02:41:24 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:25 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b 1073741824" returned: 0 in 0.614s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:25 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b Jul 25 02:41:25 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:25 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b" returned: 0 in 0.419s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Attempting download of 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume 0efc781b-87fa-48b5-9f4d-64ee3871f28b. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72c7777-e166-40ee-9263-524d0a1179b8]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:26 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44 Jul 25 02:41:26 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:26 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44" returned: 0 in 0.565s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:26 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44 Jul 25 02:41:26 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:27 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44" returned: 1 in 0.384s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_nddn1g44' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa24e6d-28ec-4894-bc09-6596af8579e6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:27 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD Jul 25 02:41:27 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:27 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] 19c99a4c-891e-4766-a74f-7e24d755618e was qcow2, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:41:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:27 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b Jul 25 02:41:27 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:29 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b" returned: 0 in 1.972s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_qg_1_mdldevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:41:29 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Converted 112.00 MB image at 56.75 MB/s Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:29 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b 1G Jul 25 02:41:29 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:29 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b 1G" returned: 0 in 0.348s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Downloaded image 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume 0efc781b-87fa-48b5-9f4d-64ee3871f28b successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e for user 029d3ce59c2049d6b637035c6b873874 is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Marking volume 0efc781b-87fa-48b5-9f4d-64ee3871f28b as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Copying metadata from image 19c99a4c-891e-4766-a74f-7e24d755618e to 0efc781b-87fa-48b5-9f4d-64ee3871f28b. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Creating volume glance metadata for volume 0efc781b-87fa-48b5-9f4d-64ee3871f28b backed by image 19c99a4c-891e-4766-a74f-7e24d755618e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12ec6e3-c1f6-4d6d-bfbd-214c16afca86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc9f79f-f46e-43d2-8dce-172b57db0c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Volume volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b (0efc781b-87fa-48b5-9f4d-64ee3871f28b): created successfully Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc9f79f-f46e-43d2-8dce-172b57db0c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (d4cb08f7-e855-42fa-8fa2-0a61b08f896a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b4d4dc93-fa64-47ad-b0b6-9cb1e6a80785 tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (22572565-9957-4406-ad57-eaf4f00f1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b741262a-821c-4aeb-a5b5-4f40f74b8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b741262a-821c-4aeb-a5b5-4f40f74b8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-620352643',display_name='tempest-VolumesGetTest-Volume-1744211395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390de791-b35a-4628-b7a3-14c09eecaac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:31Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e75c032-6072-4323-a6a0-1bb490e3bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e75c032-6072-4323-a6a0-1bb490e3bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c34247f-e081-4742-8c78-dcf5a0de3642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c34247f-e081-4742-8c78-dcf5a0de3642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390de791-b35a-4628-b7a3-14c09eecaac5', 'volume_name': 'volume-390de791-b35a-4628-b7a3-14c09eecaac5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa467f8e-2116-4768-9efc-533d12bcd241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa467f8e-2116-4768-9efc-533d12bcd241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf17cc0-996e-4b13-9872-7de2ef0e3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Volume 390de791-b35a-4628-b7a3-14c09eecaac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390de791-b35a-4628-b7a3-14c09eecaac5', 'volume_size': 1} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-620352643',display_name='tempest-VolumesGetTest-Volume-1744211395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390de791-b35a-4628-b7a3-14c09eecaac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6079a85118ce43a0800e5fc86a7935cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:31Z,use_quota=True,user_id='029d3ce59c2049d6b637035c6b873874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Creating volume 390de791-b35a-4628-b7a3-14c09eecaac5 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:41:31 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:31 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 1073741824 Jul 25 02:41:31 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:31 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 1073741824" returned: 0 in 0.412s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:31 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 Jul 25 02:41:31 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:32 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5" returned: 0 in 0.243s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf17cc0-996e-4b13-9872-7de2ef0e3109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390de791-b35a-4628-b7a3-14c09eecaac5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3537e22-c3ba-4339-9535-6b568284bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Volume volume-390de791-b35a-4628-b7a3-14c09eecaac5 (390de791-b35a-4628-b7a3-14c09eecaac5): created successfully Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3537e22-c3ba-4339-9535-6b568284bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Flow 'volume_create_manager' (22572565-9957-4406-ad57-eaf4f00f1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4e141ed5-c3bb-411c-b0d8-54f5242896c9 tempest-VolumesGetTest-1264959713 None] Created volume successfully. Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-390de791-b35a-4628-b7a3-14c09eecaac5-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Lock "cinder-390de791-b35a-4628-b7a3-14c09eecaac5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-390de791-b35a-4628-b7a3-14c09eecaac5" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-390de791-b35a-4628-b7a3-14c09eecaac5" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[116fe9f4-defb-4f62-b7ec-c1730e36aec3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:32 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 Jul 25 02:41:32 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:32 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5" returned: 0 in 0.393s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:32 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5 Jul 25 02:41:32 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:33 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-390de791-b35a-4628-b7a3-14c09eecaac5" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-390de791-b35a-4628-b7a3-14c09eecaac5" released by "delete_volume" :: held 0.696s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Created reservations ['31c336f8-b12b-4893-942e-f27d27065ac9', '29ef509c-ae3d-4a7f-b2c1-dfc92806bce8', '14d3277f-9f96-49e3-a117-2b14b41bd97d', 'd402b782-6918-4823-98ac-ffcaa4f48aeb'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:33 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:33 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:33 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ec6203c-f052-4292-8a42-c1978bf0e9e4 tempest-VolumesGetTest-1264959713 None] Lock "cinder-390de791-b35a-4628-b7a3-14c09eecaac5-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-0efc781b-87fa-48b5-9f4d-64ee3871f28b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Lock "cinder-0efc781b-87fa-48b5-9f4d-64ee3871f28b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Acquiring lock "cinder-quobyte-0efc781b-87fa-48b5-9f4d-64ee3871f28b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-0efc781b-87fa-48b5-9f4d-64ee3871f28b" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a478f6-68fd-440a-9a41-daedf253256e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:33 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b Jul 25 02:41:33 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:34 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:34 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b Jul 25 02:41:34 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:34 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0efc781b-87fa-48b5-9f4d-64ee3871f28b" returned: 0 in 0.270s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Lock "cinder-quobyte-0efc781b-87fa-48b5-9f4d-64ee3871f28b" released by "delete_volume" :: held 0.685s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Created reservations ['8fc3903e-e95c-4759-8458-7d9b7156088b', '04b52703-3c78-4fe1-8fca-ad8393311adb', '56f1e35e-7f60-409d-be0c-2ed88708dce1', '937f9075-505f-40e5-899a-712125278007'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:34 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:34 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:34 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Deleted volume successfully. Jul 25 02:41:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-00446a12-97de-4d64-9027-a7ffb239a60c tempest-VolumesGetTest-1264959713 None] Lock "cinder-0efc781b-87fa-48b5-9f4d-64ee3871f28b-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8912945-e8ff-47b4-8ca5-46b4fc813e55]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:37 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 Jul 25 02:41:37 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:37 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11" returned: 0 in 0.399s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.442s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:37 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-006a2178-ac84-460a-b951-5fd46a608b11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af4ed142-7eb3-4e0e-a406-3199b0c0da13', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:41:37 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-e55e64d4-84e1-4ea0-847e-7f7875d1a79c req-d2638429-280b-4bfd-94ef-80dae0a9deb1 tempest-TestStampPattern-291827384 None] attachment_update completed successfully. Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Flow 'volume_create_manager' (e3c26d32-9a5d-4ac8-8e0d-bc5feb07eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfcb6a2-a3d8-4446-8475-a825cf1c3dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfcb6a2-a3d8-4446-8475-a825cf1c3dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-171434187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85670342-2092-41ef-8b7a-228583a179ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983cfe77f494dcd9ad7d2f3d8898076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:38Z,use_quota=True,user_id='2ec7bf6bb0ee4491975ee48eedbb6052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79444e83-9e83-4b4c-81fb-610bb6f05804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79444e83-9e83-4b4c-81fb-610bb6f05804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8797af-7d74-4190-b000-89bd2944730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8797af-7d74-4190-b000-89bd2944730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85670342-2092-41ef-8b7a-228583a179ec', 'volume_name': 'volume-85670342-2092-41ef-8b7a-228583a179ec', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76f5156-8cb1-4474-b398-02fc22e80b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76f5156-8cb1-4474-b398-02fc22e80b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2c41ec-060b-48e5-af40-83d96244d5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:38 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Volume 85670342-2092-41ef-8b7a-228583a179ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85670342-2092-41ef-8b7a-228583a179ec', 'volume_size': 1} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-171434187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85670342-2092-41ef-8b7a-228583a179ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6983cfe77f494dcd9ad7d2f3d8898076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:38Z,use_quota=True,user_id='2ec7bf6bb0ee4491975ee48eedbb6052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Creating volume 85670342-2092-41ef-8b7a-228583a179ec {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:41:38 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:38 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec 1073741824 Jul 25 02:41:38 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:38 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec 1073741824" returned: 0 in 0.525s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:38 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec Jul 25 02:41:38 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:39 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2c41ec-060b-48e5-af40-83d96244d5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85670342-2092-41ef-8b7a-228583a179ec', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6b2e02-f71e-48e6-9d8e-3d8619c2d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Volume volume-85670342-2092-41ef-8b7a-228583a179ec (85670342-2092-41ef-8b7a-228583a179ec): created successfully Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6b2e02-f71e-48e6-9d8e-3d8619c2d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Flow 'volume_create_manager' (e3c26d32-9a5d-4ac8-8e0d-bc5feb07eba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5fbd5534-161f-4044-8d97-172c0823aee9 tempest-VolumesNegativeTest-556848165 None] Created volume successfully. Jul 25 02:41:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-4f266c02-0e76-4e50-ba88-f2a1c6de6563 req-3344ff85-515e-4d03-a827-786f4287878a tempest-TestStampPattern-291827384 None] Terminate volume connection completed successfully. Jul 25 02:41:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-4f266c02-0e76-4e50-ba88-f2a1c6de6563 req-3344ff85-515e-4d03-a827-786f4287878a tempest-TestStampPattern-291827384 None] Deleting attachment af4ed142-7eb3-4e0e-a406-3199b0c0da13. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:41:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-006a2178-ac84-460a-b951-5fd46a608b11-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Lock "cinder-006a2178-ac84-460a-b951-5fd46a608b11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-quobyte-006a2178-ac84-460a-b951-5fd46a608b11" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-006a2178-ac84-460a-b951-5fd46a608b11" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:45 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[931e5249-3225-447e-8017-e072f69a6833]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:45 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 Jul 25 02:41:45 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:46 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11" returned: 0 in 0.616s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:46 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11 Jul 25 02:41:46 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:46 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-006a2178-ac84-460a-b951-5fd46a608b11" returned: 0 in 0.422s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-006a2178-ac84-460a-b951-5fd46a608b11" released by "delete_volume" :: held 1.083s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Created reservations ['b6950ed5-6fec-4071-a762-eb7f515eefef', '52909bdf-6695-48fc-9592-62965d920cad', '22ad974a-eae6-405e-9c06-b8fd8b5e9445', 'b0212865-7d03-4d4b-b110-c81c7be6b21f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:46 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:46 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:47 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:47 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:47 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Deleted volume successfully. Jul 25 02:41:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-888192a9-ce94-4004-ad64-f05f0112b077 tempest-TestStampPattern-291827384 None] Lock "cinder-006a2178-ac84-460a-b951-5fd46a608b11-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-d6272f11-c380-4b28-b6ee-af700ac21cfe-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Lock "cinder-d6272f11-c380-4b28-b6ee-af700ac21cfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-quobyte-c2cf16fd-df70-444d-853e-599a73f6681e" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-c2cf16fd-df70-444d-853e-599a73f6681e" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-quobyte-d6272f11-c380-4b28-b6ee-af700ac21cfe" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-d6272f11-c380-4b28-b6ee-af700ac21cfe" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Deleting offline snapshot d6272f11-c380-4b28-b6ee-af700ac21cfe of volume c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] snapshot_file for this snap is: volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4991d4-6c81-4889-9078-7df76ea4e1d6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:48 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe Jul 25 02:41:48 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:48 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe" returned: 0 in 0.531s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2cf16fd-df70-444d-853e-599a73f6681e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f1071-2487-46eb-935c-552d5c680904]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:49 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:41:49 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:49 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 0.498s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:49 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe Jul 25 02:41:49 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:49 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe" returned: 0 in 0.568s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:50 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe Jul 25 02:41:50 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:50 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e.d6272f11-c380-4b28-b6ee-af700ac21cfe" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-d6272f11-c380-4b28-b6ee-af700ac21cfe" released by "_delete_snapshot" :: held 2.096s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-c2cf16fd-df70-444d-853e-599a73f6681e" released by "delete_snapshot" :: held 2.134s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Created reservations ['a74a6ef6-debd-4580-927d-87babc6a1ebf', '7d64bfd9-f9d6-437e-aee0-c8ccb35edc11', 'b12d8ba3-7754-4974-b743-aeb2cc3a466f', '16d5b27c-78f0-4481-856e-6476d6499491'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=96,cinder:SELECT=84,cinder:DELETE=7,cinder:INSERT=32 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:41:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Delete snapshot completed successfully. Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fd6a0865-67b1-418a-99cf-abed7f6ac7fd tempest-TestStampPattern-291827384 None] Lock "cinder-d6272f11-c380-4b28-b6ee-af700ac21cfe-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:50 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:50 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:51 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.296s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:41:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:41:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=79,cinder:UPDATE=103,cinder:INSERT=27,cinder:DELETE=10 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Flow 'volume_create_manager' (ae1ec893-3abe-4e0b-b3a1-81b48c342db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19cb3bb-8d3f-4c13-b050-e1af68fbd96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19cb3bb-8d3f-4c13-b050-e1af68fbd96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766097305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80cd44a-b836-4b1b-bc1e-beb5f66a1d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea09394cee42db971be4fd19a50c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:53Z,use_quota=True,user_id='33e5f7ee326c4baa9e2b059d677742f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a480bdf0-705e-4f46-a433-d7127bdda8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a480bdf0-705e-4f46-a433-d7127bdda8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16b56c7-8319-4c3b-afa2-18358a0077de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16b56c7-8319-4c3b-afa2-18358a0077de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80cd44a-b836-4b1b-bc1e-beb5f66a1d65', 'volume_name': 'volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d885ce-ff68-43ac-912b-43eb8a13b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d885ce-ff68-43ac-912b-43eb8a13b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcaf22e-b136-44ca-83a1-8a03fd9a2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:53 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Volume a80cd44a-b836-4b1b-bc1e-beb5f66a1d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65', 'volume_size': 1} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766097305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80cd44a-b836-4b1b-bc1e-beb5f66a1d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea09394cee42db971be4fd19a50c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:41:53Z,use_quota=True,user_id='33e5f7ee326c4baa9e2b059d677742f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Creating volume a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:41:53 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:41:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:53 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 1073741824 Jul 25 02:41:53 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:54 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 1073741824" returned: 0 in 0.621s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:54 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 Jul 25 02:41:54 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:54 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcaf22e-b136-44ca-83a1-8a03fd9a2656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8c833c-c4ee-4af8-998f-9204e81a122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:41:54 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Volume volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 (a80cd44a-b836-4b1b-bc1e-beb5f66a1d65): created successfully Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8c833c-c4ee-4af8-998f-9204e81a122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:41:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Flow 'volume_create_manager' (ae1ec893-3abe-4e0b-b3a1-81b48c342db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:41:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0b753791-d010-4969-868d-6f453d7f98d8 tempest-AttachVolumeNegativeTest-1300142540 None] Created volume successfully. Jul 25 02:41:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-c2cf16fd-df70-444d-853e-599a73f6681e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Lock "cinder-c2cf16fd-df70-444d-853e-599a73f6681e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Acquiring lock "cinder-quobyte-c2cf16fd-df70-444d-853e-599a73f6681e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-c2cf16fd-df70-444d-853e-599a73f6681e" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[179bfd2e-60dd-4e92-ae53-003688d5c449]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:55 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:41:55 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:56 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:56 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e Jul 25 02:41:56 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:56 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2cf16fd-df70-444d-853e-599a73f6681e" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Lock "cinder-quobyte-c2cf16fd-df70-444d-853e-599a73f6681e" released by "delete_volume" :: held 0.898s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-01c44a9e-0dde-4cfa-b491-21493213d40f req-35614c32-dccd-4998-8479-5b4da4f543e9 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-01c44a9e-0dde-4cfa-b491-21493213d40f req-35614c32-dccd-4998-8479-5b4da4f543e9 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-01c44a9e-0dde-4cfa-b491-21493213d40f req-35614c32-dccd-4998-8479-5b4da4f543e9 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Created reservations ['5a2e6203-4125-4cac-b145-c77819af2010', '57707146-48fb-44f9-891e-a9331e8663cd', 'f42a198f-eac3-4df6-adfb-7a4903bc4962', 'fae2235c-a129-4285-aa53-ef45d987ce0a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-01c44a9e-0dde-4cfa-b491-21493213d40f req-35614c32-dccd-4998-8479-5b4da4f543e9 tempest-AttachVolumeNegativeTest-1300142540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c83130-aebe-4f9c-9a53-41fe560d2fe8', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:41:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-01c44a9e-0dde-4cfa-b491-21493213d40f req-35614c32-dccd-4998-8479-5b4da4f543e9 tempest-AttachVolumeNegativeTest-1300142540 None] attachment_update completed successfully. Jul 25 02:41:56 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:41:56 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:41:56 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:41:56 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:41:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Deleted volume successfully. Jul 25 02:41:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e4ed66a3-f03e-49ac-a724-ea5fbd5220ef tempest-TestStampPattern-291827384 None] Lock "cinder-c2cf16fd-df70-444d-853e-599a73f6681e-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:41:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-a6a54c1c-3cce-4761-9d4c-acc003e32624 req-e853f155-2554-4434-ac74-5dd40648b075 tempest-AttachVolumeNegativeTest-1300142540 None] Terminate volume connection completed successfully. Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-a6a54c1c-3cce-4761-9d4c-acc003e32624 req-e853f155-2554-4434-ac74-5dd40648b075 tempest-AttachVolumeNegativeTest-1300142540 None] Deleting attachment 68c83130-aebe-4f9c-9a53-41fe560d2fe8. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Acquiring lock "cinder-85670342-2092-41ef-8b7a-228583a179ec-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Lock "cinder-85670342-2092-41ef-8b7a-228583a179ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Acquiring lock "cinder-quobyte-85670342-2092-41ef-8b7a-228583a179ec" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Lock "cinder-quobyte-85670342-2092-41ef-8b7a-228583a179ec" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[184688a0-163a-4a89-9faa-4cb01f946e17]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:41:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:00 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec Jul 25 02:42:00 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:00 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec" returned: 0 in 0.406s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:00 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec Jul 25 02:42:00 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:00 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-85670342-2092-41ef-8b7a-228583a179ec" returned: 0 in 0.311s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Lock "cinder-quobyte-85670342-2092-41ef-8b7a-228583a179ec" released by "delete_volume" :: held 0.792s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Created reservations ['aa7aef8c-65c4-4a11-b3ff-3f8d6a753260', '78a4b91a-1af6-4bfa-a96b-77d4e588f061', '997acdd5-710f-4a79-9f54-f3f0b31c209b', '5a6b2219-2cc4-4180-867d-ab078e7d6c6e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:00 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:00 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:01 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:01 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Deleted volume successfully. Jul 25 02:42:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4a65d9cc-d2da-4637-828b-8faebfe8ed58 tempest-VolumesNegativeTest-556848165 None] Lock "cinder-85670342-2092-41ef-8b7a-228583a179ec-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Flow 'volume_create_manager' (98d510ed-ce26-4e52-87d3-864420dc7914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f75559-428c-4cf7-acc6-6e3cbc98e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f75559-428c-4cf7-acc6-6e3cbc98e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1141435328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8a488c-6998-4286-bb26-640e4cce72e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053e367467c5498d9270a20771ed5396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:05Z,use_quota=True,user_id='dcab3a415be04315a8f6989cf8565e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b27522-9b8a-4a56-a6e2-8fe99fb7cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b27522-9b8a-4a56-a6e2-8fe99fb7cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c04b661-bfbc-4226-9f06-deed84820fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c04b661-bfbc-4226-9f06-deed84820fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8a488c-6998-4286-bb26-640e4cce72e1', 'volume_name': 'volume-6b8a488c-6998-4286-bb26-640e4cce72e1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7faef9e4-26af-46bc-b92d-4736a005daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7faef9e4-26af-46bc-b92d-4736a005daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075f084f-8888-4cc6-abe4-42921a4fa835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Volume 6b8a488c-6998-4286-bb26-640e4cce72e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8a488c-6998-4286-bb26-640e4cce72e1', 'volume_size': 1} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1141435328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8a488c-6998-4286-bb26-640e4cce72e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053e367467c5498d9270a20771ed5396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:05Z,use_quota=True,user_id='dcab3a415be04315a8f6989cf8565e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Creating volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:04 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:04 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 1073741824 Jul 25 02:42:04 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:05 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 1073741824" returned: 0 in 0.517s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:05 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 Jul 25 02:42:05 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:05 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1" returned: 0 in 0.310s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075f084f-8888-4cc6-abe4-42921a4fa835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8a488c-6998-4286-bb26-640e4cce72e1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b24b4df-9179-4474-af97-0a19e9e76636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:05 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Volume volume-6b8a488c-6998-4286-bb26-640e4cce72e1 (6b8a488c-6998-4286-bb26-640e4cce72e1): created successfully Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b24b4df-9179-4474-af97-0a19e9e76636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Flow 'volume_create_manager' (98d510ed-ce26-4e52-87d3-864420dc7914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2df77185-adcb-4594-b1df-cf914a7f7212 tempest-VolumesSnapshotListTestJSON-952517538 None] Created volume successfully. Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Creating offline snapshot 5d924f0f-97fb-42f9-9d84-2c788a218c8f of volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d2fba6-86c1-4fc6-aecf-a5d3925dfbab]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:07 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 Jul 25 02:42:07 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:07 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1" returned: 0 in 0.439s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:07 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f 1G Jul 25 02:42:07 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:08 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f 1G" returned: 0 in 0.529s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:08 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:08 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:08 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.380s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:08 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f is being set with open permissions: ugo+rw Jul 25 02:42:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:08 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:08 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:08 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:08 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info Jul 25 02:42:08 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:09 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info" returned: 0 in 0.311s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:09 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info is being set with open permissions: ugo+rw Jul 25 02:42:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:09 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info Jul 25 02:42:09 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:09 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.info" returned: 0 in 0.279s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-042cd111-fec9-4a65-aaf4-d05244452e29 tempest-VolumesSnapshotListTestJSON-952517538 None] Create snapshot completed successfully Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Creating offline snapshot 657aa663-6bb0-451e-9bda-d81015c959ba of volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf64633-e470-407c-8399-eb65fc11616d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:10 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:10 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:10 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:10 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba 1G Jul 25 02:42:10 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:11 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba 1G" returned: 0 in 0.634s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:11 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:11 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (5ba102a2-30de-438f-b961-2040b9d5f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f14c237-70a3-4d63-ab3b-d8eced29beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f14c237-70a3-4d63-ab3b-d8eced29beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1331270892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8479bbce-5cc6-4bdb-8d5a-fd2f31caead8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:12Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dc19ec-36be-4758-9d8b-61c23d061814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dc19ec-36be-4758-9d8b-61c23d061814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25debe10-9db9-4d1f-bb55-0cf4b20c2aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25debe10-9db9-4d1f-bb55-0cf4b20c2aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8479bbce-5cc6-4bdb-8d5a-fd2f31caead8', 'volume_name': 'volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837e3007-0a47-4962-beea-239899e7b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837e3007-0a47-4962-beea-239899e7b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ae18be-bf84-475d-9fa5-9b39d6c078b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:11 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume 8479bbce-5cc6-4bdb-8d5a-fd2f31caead8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8', 'volume_size': 1} Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:11 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.308s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:11 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba is being set with open permissions: ugo+rw Jul 25 02:42:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:11 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:11 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:12 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.387s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1331270892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8479bbce-5cc6-4bdb-8d5a-fd2f31caead8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:12Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating volume 8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:12 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:12 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 1073741824 Jul 25 02:42:12 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5d40c917-0b90-4c2c-ac81-de9437b5a61b tempest-VolumesSnapshotListTestJSON-952517538 None] Create snapshot completed successfully Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:13 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 1073741824" returned: 0 in 0.905s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:13 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 Jul 25 02:42:13 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:13 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.529s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ae18be-bf84-475d-9fa5-9b39d6c078b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab33c6e-2f15-4852-81fc-cd18278824eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Creating offline snapshot 05114482-3b8d-4368-874c-9bf6e2ffb8ff of volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:42:13 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 (8479bbce-5cc6-4bdb-8d5a-fd2f31caead8): created successfully Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab33c6e-2f15-4852-81fc-cd18278824eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (5ba102a2-30de-438f-b961-2040b9d5f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37240b6-6db3-42c1-83c2-2e1bad6693db]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e306558f-c5f3-4442-991b-5c5ffd5413a0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created volume successfully. Jul 25 02:42:13 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:13 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:14 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:14 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff 1G Jul 25 02:42:14 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:14 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff 1G" returned: 0 in 0.668s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:14 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff Jul 25 02:42:14 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:15 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff" returned: 0 in 0.337s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:15 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff is being set with open permissions: ugo+rw Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:15 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff Jul 25 02:42:15 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:15 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff" returned: 0 in 0.257s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.757s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.356s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating offline snapshot 0ce95f40-95f5-4701-bee6-f4f387fae3e1 of volume 8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:42:15 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-15bb5b15-100f-482e-990f-6f4e79f47afe tempest-VolumesSnapshotListTestJSON-952517538 None] Create snapshot completed successfully Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa52ad8-f95f-46f0-ab52-c89e88a8613c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:15 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 Jul 25 02:42:15 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:15 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:15 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 1G Jul 25 02:42:15 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:16 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 1G" returned: 0 in 0.574s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:16 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 Jul 25 02:42:16 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:16 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:16 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 is being set with open permissions: ugo+rw Jul 25 02:42:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:16 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 Jul 25 02:42:16 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-05114482-3b8d-4368-874c-9bf6e2ffb8ff-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-05114482-3b8d-4368-874c-9bf6e2ffb8ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-05114482-3b8d-4368-874c-9bf6e2ffb8ff" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-05114482-3b8d-4368-874c-9bf6e2ffb8ff" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Deleting offline snapshot 05114482-3b8d-4368-874c-9bf6e2ffb8ff of volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:42:17 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] snapshot_file for this snap is: volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1" returned: 0 in 0.512s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[898cca8a-a9e2-4850-8e2e-da064d6f977a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:17 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info Jul 25 02:42:17 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:17 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff Jul 25 02:42:17 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:17 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info" returned: 0 in 0.379s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:17 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info is being set with open permissions: ugo+rw Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:17 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff" returned: 0 in 0.458s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:17 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info Jul 25 02:42:17 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb90cf4-647f-41fa-9c14-b4561e170126]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:17 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:17 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:17 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.info" returned: 0 in 0.310s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.677s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dd6dcde0-0fc3-4dcb-a386-29e7497c99a8 tempest-CreateVolumesFromSnapshotTest-598262203 None] Create snapshot completed successfully Jul 25 02:42:18 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.460s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:18 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff Jul 25 02:42:18 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (6872ee6e-6572-47b2-afdd-60886e971a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12cf335-d36c-44fb-9df3-806a8b30e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:18 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff" returned: 0 in 0.552s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12cf335-d36c-44fb-9df3-806a8b30e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1170759337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dfdd87-1055-4fe0-9d8c-93b18a7be514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:19Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb09d553-5bab-42bf-99a5-c1c1653c96bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb09d553-5bab-42bf-99a5-c1c1653c96bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:18 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff Jul 25 02:42:18 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60d0144-ebda-48c4-b061-6886ed35a6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60d0144-ebda-48c4-b061-6886ed35a6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52dfdd87-1055-4fe0-9d8c-93b18a7be514', 'volume_name': 'volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce35f40b-b9d3-4781-aa1a-645230ea255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce35f40b-b9d3-4781-aa1a-645230ea255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f134c48-629e-44a5-a61f-0fbae1d9bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:18 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume 52dfdd87-1055-4fe0-9d8c-93b18a7be514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514', 'volume_size': 1} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1170759337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dfdd87-1055-4fe0-9d8c-93b18a7be514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:19Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating volume 52dfdd87-1055-4fe0-9d8c-93b18a7be514 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:18 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:18 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 1073741824 Jul 25 02:42:18 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:19 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.05114482-3b8d-4368-874c-9bf6e2ffb8ff" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-05114482-3b8d-4368-874c-9bf6e2ffb8ff" released by "_delete_snapshot" :: held 1.942s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" released by "delete_snapshot" :: held 1.979s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (a8e41757-9a62-4572-bdc1-e0af880ed27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b3ea73-abbe-438d-a79c-285ba19f62fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b3ea73-abbe-438d-a79c-285ba19f62fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747477919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3d2cc0-11fe-45f8-9098-06630f8dd16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:19Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd15e411-6c02-4d5f-8814-fbe96a9858fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd15e411-6c02-4d5f-8814-fbe96a9858fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940f227b-1b4b-454f-ace6-ef3372306095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940f227b-1b4b-454f-ace6-ef3372306095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3d2cc0-11fe-45f8-9098-06630f8dd16b', 'volume_name': 'volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac14fae0-1ad0-4987-8e90-abc40662e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac14fae0-1ad0-4987-8e90-abc40662e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf3120e-741e-4892-adf8-ddb05fabf52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume ba3d2cc0-11fe-45f8-9098-06630f8dd16b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b', 'volume_size': 1} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Created reservations ['5f9d1389-5eb2-436d-829a-a1a60493be00', 'ea9b9778-9e05-4201-9067-0904ea43a457', '9a7578a2-3d17-425a-b85b-1a35c793d4fa', '20d2864e-b7e2-4374-bc0e-76dbf14d912f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Delete snapshot completed successfully. Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a32e1751-10a4-45e1-9494-c3f87452de46 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-05114482-3b8d-4368-874c-9bf6e2ffb8ff-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:19 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 1073741824" returned: 0 in 0.721s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:19 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 Jul 25 02:42:19 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (eedc70f2-c437-48fe-b9b9-8e23cee56eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbb76b2-39ea-4cf9-be0c-90daebc09391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbb76b2-39ea-4cf9-be0c-90daebc09391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934934533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50102a59-2c81-48f3-b1a3-5215bced15b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:20Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae92616-31e7-4b7f-ae88-8ded4a23cba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae92616-31e7-4b7f-ae88-8ded4a23cba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18830e1a-bb4d-4526-a409-784649a4563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18830e1a-bb4d-4526-a409-784649a4563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50102a59-2c81-48f3-b1a3-5215bced15b7', 'volume_name': 'volume-50102a59-2c81-48f3-b1a3-5215bced15b7', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91cef25-57d7-403c-80e6-fdac5f2a2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91cef25-57d7-403c-80e6-fdac5f2a2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2146e406-4270-450b-b091-dbe42654e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume 50102a59-2c81-48f3-b1a3-5215bced15b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50102a59-2c81-48f3-b1a3-5215bced15b7', 'volume_size': 1} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:19 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747477919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3d2cc0-11fe-45f8-9098-06630f8dd16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:19Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating volume ba3d2cc0-11fe-45f8-9098-06630f8dd16b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:20 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f134c48-629e-44a5-a61f-0fbae1d9bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b 1073741824 Jul 25 02:42:20 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc5822a-e559-4c96-b894-b3949b53f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 (52dfdd87-1055-4fe0-9d8c-93b18a7be514): created successfully Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc5822a-e559-4c96-b894-b3949b53f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (6872ee6e-6572-47b2-afdd-60886e971a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8813d88a-20c9-45c9-a335-d0e5fd6fb578 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created volume successfully. Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (b73c5e8f-688d-44cc-8187-3834d8b599f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e30b304-9c03-473f-8147-4bddd8ac6aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e30b304-9c03-473f-8147-4bddd8ac6aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108821640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f00e7f-e8ae-4d43-be2c-0e46c8286a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:20Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa52f00-64aa-4efd-ad29-00f54c57a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa52f00-64aa-4efd-ad29-00f54c57a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd114a4-f230-46ab-8bc2-7d2342e7152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd114a4-f230-46ab-8bc2-7d2342e7152c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f00e7f-e8ae-4d43-be2c-0e46c8286a89', 'volume_name': 'volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc58eeb-0052-4d82-8de6-488a43cb2056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc58eeb-0052-4d82-8de6-488a43cb2056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa19a25-4390-42ea-87b6-3a55e385cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume 96f00e7f-e8ae-4d43-be2c-0e46c8286a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89', 'volume_size': 1} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-657aa663-6bb0-451e-9bda-d81015c959ba-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-657aa663-6bb0-451e-9bda-d81015c959ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-657aa663-6bb0-451e-9bda-d81015c959ba" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-657aa663-6bb0-451e-9bda-d81015c959ba" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Deleting offline snapshot 657aa663-6bb0-451e-9bda-d81015c959ba of volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] snapshot_file for this snap is: volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc3e10-2e2e-4c1c-a6ff-8f20b85d3ca6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:20 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:20 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:20 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b 1073741824" returned: 0 in 0.738s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:20 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b Jul 25 02:42:20 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (d2607bc2-0493-4a5c-8b53-a8d373c6b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c16e2e-0ced-4212-90b4-30d89c13948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c16e2e-0ced-4212-90b4-30d89c13948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76381125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d27a2b8-682f-4d92-80a0-e24d46d48a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:21Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363ccd2b-16d5-4e23-bd1a-b6eecd80f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363ccd2b-16d5-4e23-bd1a-b6eecd80f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d429d0-8cd0-4001-8093-85618984ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d429d0-8cd0-4001-8093-85618984ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d27a2b8-682f-4d92-80a0-e24d46d48a9b', 'volume_name': 'volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a75bb6c-ff4b-4bd7-b407-092e411a4217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a75bb6c-ff4b-4bd7-b407-092e411a4217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b893549-38cf-44d7-8bb4-21580552082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume 6d27a2b8-682f-4d92-80a0-e24d46d48a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b', 'volume_size': 1} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:21 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.466s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed8301-fa6a-46fe-84b6-bb9f1bf45465]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:21 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b" returned: 0 in 0.289s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934934533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50102a59-2c81-48f3-b1a3-5215bced15b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:20Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating volume 50102a59-2c81-48f3-b1a3-5215bced15b7 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:21 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 1073741824 Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf3120e-741e-4892-adf8-ddb05fabf52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:21 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84722f59-de6c-42cc-bb04-d8a295af2133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b (ba3d2cc0-11fe-45f8-9098-06630f8dd16b): created successfully Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84722f59-de6c-42cc-bb04-d8a295af2133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (a8e41757-9a62-4572-bdc1-e0af880ed27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:21 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-48e74b25-7687-45e0-b428-7d0ef81a5c8a tempest-CreateVolumesFromSnapshotTest-598262203 None] Created volume successfully. Jul 25 02:42:21 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:21 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:21 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:21 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:21 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:21 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 1073741824" returned: 0 in 0.451s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:21 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 Jul 25 02:42:21 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:21 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.541s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108821640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f00e7f-e8ae-4d43-be2c-0e46c8286a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:20Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating volume 96f00e7f-e8ae-4d43-be2c-0e46c8286a89 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:21 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.396s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:21 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 1073741824 Jul 25 02:42:21 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2146e406-4270-450b-b091-dbe42654e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50102a59-2c81-48f3-b1a3-5215bced15b7', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c388d16b-3ff5-44d3-913b-136e33049489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:21 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba Jul 25 02:42:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume volume-50102a59-2c81-48f3-b1a3-5215bced15b7 (50102a59-2c81-48f3-b1a3-5215bced15b7): created successfully Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c388d16b-3ff5-44d3-913b-136e33049489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:21 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (eedc70f2-c437-48fe-b9b9-8e23cee56eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f6780fba-d7af-4116-bec2-b5b6d90ad89f tempest-CreateVolumesFromSnapshotTest-598262203 None] Created volume successfully. Jul 25 02:42:22 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.657aa663-6bb0-451e-9bda-d81015c959ba" returned: 0 in 0.308s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-657aa663-6bb0-451e-9bda-d81015c959ba" released by "_delete_snapshot" :: held 1.704s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" released by "delete_snapshot" :: held 1.732s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Created reservations ['fb631c51-7981-4f87-87fe-3eb02b366435', '47601bbb-6193-4e0b-bcd9-1ae8566ada39', '648d1da0-4963-4dd7-9dbb-20029a0044d7', 'a8e3fd35-2b13-43ba-9ecb-02e56cd9e194'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Delete snapshot completed successfully. Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-881ee16a-1616-4eea-b91e-28dc263ddb2e tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-657aa663-6bb0-451e-9bda-d81015c959ba-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:22 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 1073741824" returned: 0 in 0.508s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:22 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 Jul 25 02:42:22 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-5d924f0f-97fb-42f9-9d84-2c788a218c8f-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-5d924f0f-97fb-42f9-9d84-2c788a218c8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-5d924f0f-97fb-42f9-9d84-2c788a218c8f" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-5d924f0f-97fb-42f9-9d84-2c788a218c8f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Deleting offline snapshot 5d924f0f-97fb-42f9-9d84-2c788a218c8f of volume 6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:42:22 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] snapshot_file for this snap is: volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89" returned: 0 in 0.317s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76381125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d27a2b8-682f-4d92-80a0-e24d46d48a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c7d521f24f4e07844e1606f7aa932a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:21Z,use_quota=True,user_id='17f32d90f90945ef9d68e20430ceef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Creating volume 6d27a2b8-682f-4d92-80a0-e24d46d48a9b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:22 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24948c3-94ac-429a-bf65-79195c311fa7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:22 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b 1073741824 Jul 25 02:42:22 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa19a25-4390-42ea-87b6-3a55e385cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09aa057-4b48-4c28-982a-4e1d20cf34f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 (96f00e7f-e8ae-4d43-be2c-0e46c8286a89): created successfully Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09aa057-4b48-4c28-982a-4e1d20cf34f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (b73c5e8f-688d-44cc-8187-3834d8b599f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6866ccbe-1af3-4be3-91d3-3a7e6b9d2160 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created volume successfully. Jul 25 02:42:22 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:22 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:23 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b 1073741824" returned: 0 in 0.504s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:23 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.533s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8a488c-6998-4286-bb26-640e4cce72e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:23 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b Jul 25 02:42:23 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd76f7-e9b3-4049-8b67-61c68b7d7698]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:23 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 Jul 25 02:42:23 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:23 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b893549-38cf-44d7-8bb4-21580552082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c570ce-8103-4a60-b029-d2e3dcf5f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:23 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Volume volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b (6d27a2b8-682f-4d92-80a0-e24d46d48a9b): created successfully Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c570ce-8103-4a60-b029-d2e3dcf5f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Flow 'volume_create_manager' (d2607bc2-0493-4a5c-8b53-a8d373c6b812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f0463443-a89e-4d1e-ae25-9ad9f858ca29 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created volume successfully. Jul 25 02:42:23 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1" returned: 0 in 0.409s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:23 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:23 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:24 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.373s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:24 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f Jul 25 02:42:24 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-6d27a2b8-682f-4d92-80a0-e24d46d48a9b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-6d27a2b8-682f-4d92-80a0-e24d46d48a9b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:24 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-6d27a2b8-682f-4d92-80a0-e24d46d48a9b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1.5d924f0f-97fb-42f9-9d84-2c788a218c8f" returned: 0 in 0.410s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-6d27a2b8-682f-4d92-80a0-e24d46d48a9b" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5308b1-856b-44c9-a642-9676561d4aa0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-5d924f0f-97fb-42f9-9d84-2c788a218c8f" released by "_delete_snapshot" :: held 1.911s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" released by "delete_snapshot" :: held 1.953s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:24 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b Jul 25 02:42:24 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Created reservations ['5b12aace-e505-4b26-8f93-5f7d01735a63', '492841f4-7368-4996-bbf5-ef431862a98a', 'a788a4b7-e982-45c3-8b62-77b7e7096660', 'e1711ac5-d2fa-4a03-99e1-f78273e3d63a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:24 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Delete snapshot completed successfully. Jul 25 02:42:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c8cb91b-755d-47de-9059-3f6ec75f1f43 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-5d924f0f-97fb-42f9-9d84-2c788a218c8f-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:25 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b" returned: 0 in 0.432s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:25 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b Jul 25 02:42:25 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:25 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6d27a2b8-682f-4d92-80a0-e24d46d48a9b" returned: 0 in 0.270s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-6d27a2b8-682f-4d92-80a0-e24d46d48a9b" released by "delete_volume" :: held 0.762s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['b7638bf5-87ec-422d-a601-7b6e2cd63150', '15da57ba-9e7c-488c-b28d-3a2fce0f1c6f', '63dc22d7-5ce9-4c27-bb52-2954ad43b5d1', 'eacb82bc-1b6c-4354-9bd7-db0ec9dbd321'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:25 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:25 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-96f00e7f-e8ae-4d43-be2c-0e46c8286a89-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-96f00e7f-e8ae-4d43-be2c-0e46c8286a89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-96f00e7f-e8ae-4d43-be2c-0e46c8286a89" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:25 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-96f00e7f-e8ae-4d43-be2c-0e46c8286a89" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.316s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleted volume successfully. Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c82bde-a57d-48d8-8d7b-0d666b78e442]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2de047d9-5f4b-4014-8ee7-496644db85b0 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-6d27a2b8-682f-4d92-80a0-e24d46d48a9b-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:25 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 Jul 25 02:42:25 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-6b8a488c-6998-4286-bb26-640e4cce72e1-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-6b8a488c-6998-4286-bb26-640e4cce72e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7428ca-b10c-431c-b411-b31fb577c559]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:26 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89" returned: 0 in 0.448s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:26 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 Jul 25 02:42:26 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:26 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89 Jul 25 02:42:26 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:26 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:26 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-96f00e7f-e8ae-4d43-be2c-0e46c8286a89" returned: 0 in 0.311s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1" returned: 0 in 0.453s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-96f00e7f-e8ae-4d43-be2c-0e46c8286a89" released by "delete_volume" :: held 0.822s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:26 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1 Jul 25 02:42:26 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['5cebed63-bb4d-46b4-9b8d-298e62bda6f1', '412cbedf-9948-42ed-b8ac-e8cf3034a098', '6ed6ae25-7f42-44a4-8c2c-604556d18d44', 'c74bbced-179f-4f5d-b2ce-863202ee2e88'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:26 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:26 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:26 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6b8a488c-6998-4286-bb26-640e4cce72e1" returned: 0 in 0.297s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-quobyte-6b8a488c-6998-4286-bb26-640e4cce72e1" released by "delete_volume" :: held 0.819s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-50102a59-2c81-48f3-b1a3-5215bced15b7-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-50102a59-2c81-48f3-b1a3-5215bced15b7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Created reservations ['664b9fc4-9676-4b40-8dda-835c2580bfec', '97d5b8d7-2c50-4918-9873-c37b95b9d44c', '65c0630f-c570-4db7-aa65-f09ba123db92', '3c098cc4-f454-4c3b-ae4c-7c27cd87c08c'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-50102a59-2c81-48f3-b1a3-5215bced15b7" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:26 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.292s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:26 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-50102a59-2c81-48f3-b1a3-5215bced15b7" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleted volume successfully. Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca549285-56fe-4e9a-a06f-d5c3cc6b50c0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a248867d-414a-4d85-832c-23e20f49c9fb tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-96f00e7f-e8ae-4d43-be2c-0e46c8286a89-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:27 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:27 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:27 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 Jul 25 02:42:27 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:27 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Deleted volume successfully. Jul 25 02:42:27 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-549d2326-7507-4f41-b42a-484f7492c469 tempest-VolumesSnapshotListTestJSON-952517538 None] Lock "cinder-6b8a488c-6998-4286-bb26-640e4cce72e1-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:27 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7 Jul 25 02:42:27 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:27 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-50102a59-2c81-48f3-b1a3-5215bced15b7" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-50102a59-2c81-48f3-b1a3-5215bced15b7" released by "delete_volume" :: held 0.708s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['60eb74b9-291c-43d8-ab2a-ae92dac14ed1', '814c1543-7952-41fb-93d3-edbfbfc4544b', 'f96dbae8-ea5a-4ea7-91b0-f2d491e8e401', '69195a66-5e4c-47cf-bb96-9f49c8a9276e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:27 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:27 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-ba3d2cc0-11fe-45f8-9098-06630f8dd16b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:28 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:28 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleted volume successfully. Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-ba3d2cc0-11fe-45f8-9098-06630f8dd16b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d04da6c5-671e-4bd3-8d63-cec5b6cce0b4 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-50102a59-2c81-48f3-b1a3-5215bced15b7-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-ba3d2cc0-11fe-45f8-9098-06630f8dd16b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-ba3d2cc0-11fe-45f8-9098-06630f8dd16b" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf44c156-03fe-4367-89c3-da15a891216a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:28 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b Jul 25 02:42:28 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:28 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b" returned: 0 in 0.404s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:28 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b Jul 25 02:42:28 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:28 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ba3d2cc0-11fe-45f8-9098-06630f8dd16b" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-ba3d2cc0-11fe-45f8-9098-06630f8dd16b" released by "delete_volume" :: held 0.726s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:28 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['37b052c1-37fc-4e6b-98b7-85df60a80d0f', '4bdf7b3e-6a05-41a9-b4da-fdd17d1ac8e1', '38e70395-107a-46d3-b477-8f5d146f0c5d', 'ff109db1-8c7b-44a7-b742-a2a275f36f01'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:29 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:29 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-52dfdd87-1055-4fe0-9d8c-93b18a7be514-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-52dfdd87-1055-4fe0-9d8c-93b18a7be514-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:29 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.295s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleted volume successfully. Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1b44022e-aa9f-498a-8b8b-3d63cba4838a tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-ba3d2cc0-11fe-45f8-9098-06630f8dd16b-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-52dfdd87-1055-4fe0-9d8c-93b18a7be514" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-52dfdd87-1055-4fe0-9d8c-93b18a7be514" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5743c-2e45-4b29-8081-6a7849ea50a2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:29 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 Jul 25 02:42:29 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:29 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514" returned: 0 in 0.400s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:29 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514 Jul 25 02:42:29 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:30 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-52dfdd87-1055-4fe0-9d8c-93b18a7be514" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-52dfdd87-1055-4fe0-9d8c-93b18a7be514" released by "delete_volume" :: held 0.705s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['76ee2d7f-6bc8-4701-adc2-57289895fe09', '28ed1321-b9e4-4359-aace-353e8ababf2d', '74298960-3b37-4651-a163-ddc21d2cb91a', 'b69e78b0-c0f9-4c62-80d0-e752072ecf28'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:30 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:30 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-0ce95f40-95f5-4701-bee6-f4f387fae3e1-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-0ce95f40-95f5-4701-bee6-f4f387fae3e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-0ce95f40-95f5-4701-bee6-f4f387fae3e1" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-0ce95f40-95f5-4701-bee6-f4f387fae3e1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleting offline snapshot 0ce95f40-95f5-4701-bee6-f4f387fae3e1 of volume 8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:42:30 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] snapshot_file for this snap is: volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.288s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:30 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleted volume successfully. Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fb2864-2146-4f6b-b52a-08a8a99b5fe0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9bd45c9c-4f30-426f-b259-f018953c0121 tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-52dfdd87-1055-4fe0-9d8c-93b18a7be514-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:30 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 Jul 25 02:42:30 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:30 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[886502c4-a968-44d1-a86d-714a612f60a4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:31 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 Jul 25 02:42:31 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:31 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:31 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 Jul 25 02:42:31 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:31 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1" returned: 0 in 0.330s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:31 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1 Jul 25 02:42:31 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:31 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8.0ce95f40-95f5-4701-bee6-f4f387fae3e1" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-0ce95f40-95f5-4701-bee6-f4f387fae3e1" released by "_delete_snapshot" :: held 1.486s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" released by "delete_snapshot" :: held 1.516s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['4fde02b6-6ebf-4968-949e-0538081b4da9', 'abe2c471-783b-401b-adce-e24ac4866717', '8ed874b2-6d33-477e-a67b-6ff00edacd3a', 'a047852f-4e64-43fe-8081-e5def3354949'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Delete snapshot completed successfully. Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4e1bbb53-9cb8-49ec-aed2-62669fce85ed tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-0ce95f40-95f5-4701-bee6-f4f387fae3e1-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "cinder-quobyte-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b2aa1-a216-4063-bce3-226a05eacc83]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:32 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 Jul 25 02:42:32 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:33 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" returned: 0 in 0.414s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:33 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8 Jul 25 02:42:33 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:33 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-quobyte-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8" released by "delete_volume" :: held 0.931s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Created reservations ['5ef7307d-1f65-4587-a8ac-b38eb3cee3a4', '110c6396-f9a5-4034-a092-e7595047ddd6', 'a85d21d6-e12c-44b2-8fc0-ac48f20ce94f', 'dabf36d9-207a-4733-9d1b-9a55ec12c325'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:33 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:33 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:34 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.435s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Deleted volume successfully. Jul 25 02:42:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f1344d9b-8c91-4ca5-addd-bff0920effcd tempest-CreateVolumesFromSnapshotTest-598262203 None] Lock "cinder-8479bbce-5cc6-4bdb-8d5a-fd2f31caead8-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:37 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Flow 'volume_create_manager' (26cfa6b2-8866-48d7-b1b7-ebb6dcb46fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9d2e0c-e32e-435a-aff5-80a11214e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9d2e0c-e32e-435a-aff5-80a11214e207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1401701645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd2e07f-0000-4837-8962-4fa398ba0b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea09394cee42db971be4fd19a50c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:38Z,use_quota=True,user_id='33e5f7ee326c4baa9e2b059d677742f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45219ee1-47a5-46b2-9ef0-a77f41460c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45219ee1-47a5-46b2-9ef0-a77f41460c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0507cefd-ee6b-4fe8-9c9f-c4717d167542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0507cefd-ee6b-4fe8-9c9f-c4717d167542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd2e07f-0000-4837-8962-4fa398ba0b28', 'volume_name': 'volume-ccd2e07f-0000-4837-8962-4fa398ba0b28', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8655ae09-1259-4175-b019-a199a5c38e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8655ae09-1259-4175-b019-a199a5c38e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9b166f-fa29-4388-a4d4-c9ebf679297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Volume ccd2e07f-0000-4837-8962-4fa398ba0b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd2e07f-0000-4837-8962-4fa398ba0b28', 'volume_size': 1} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1401701645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd2e07f-0000-4837-8962-4fa398ba0b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea09394cee42db971be4fd19a50c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:38Z,use_quota=True,user_id='33e5f7ee326c4baa9e2b059d677742f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Creating volume ccd2e07f-0000-4837-8962-4fa398ba0b28 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:38 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:38 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 1073741824 Jul 25 02:42:38 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (7b9bce6c-c605-4773-8d5e-b747d4c65fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879ba2b4-3497-4008-ad5e-bf26c32dafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879ba2b4-3497-4008-ad5e-bf26c32dafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997846561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc49d48-fc42-4643-9616-4f3651a2fc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:38Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31d69bc-ad88-4a3a-a5d3-61fc884cead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31d69bc-ad88-4a3a-a5d3-61fc884cead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445da156-9e5d-4336-a26c-06636b10e62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445da156-9e5d-4336-a26c-06636b10e62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc49d48-fc42-4643-9616-4f3651a2fc15', 'volume_name': 'volume-2cc49d48-fc42-4643-9616-4f3651a2fc15', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cc6d6f-bd03-4db0-9756-4acdf345d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cc6d6f-bd03-4db0-9756-4acdf345d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90450599-be6a-497c-a9e4-00d2faacd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:38 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume 2cc49d48-fc42-4643-9616-4f3651a2fc15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc49d48-fc42-4643-9616-4f3651a2fc15', 'volume_size': 1} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:38 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 1073741824" returned: 0 in 0.602s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:38 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 Jul 25 02:42:38 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:38 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997846561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc49d48-fc42-4643-9616-4f3651a2fc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:38Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Creating volume 2cc49d48-fc42-4643-9616-4f3651a2fc15 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:39 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9b166f-fa29-4388-a4d4-c9ebf679297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd2e07f-0000-4837-8962-4fa398ba0b28', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b42a54-085c-4424-982f-c795599afbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:39 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 1073741824 Jul 25 02:42:39 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Volume volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 (ccd2e07f-0000-4837-8962-4fa398ba0b28): created successfully Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b42a54-085c-4424-982f-c795599afbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Flow 'volume_create_manager' (26cfa6b2-8866-48d7-b1b7-ebb6dcb46fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-737fb474-9021-46e3-b24c-da2b719c1435 tempest-AttachVolumeNegativeTest-1300142540 None] Created volume successfully. Jul 25 02:42:39 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 1073741824" returned: 0 in 0.542s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:39 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 Jul 25 02:42:39 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:39 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90450599-be6a-497c-a9e4-00d2faacd26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc49d48-fc42-4643-9616-4f3651a2fc15', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecfd08-1a12-4e54-8ee5-83a3ba7ae654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 (2cc49d48-fc42-4643-9616-4f3651a2fc15): created successfully Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecfd08-1a12-4e54-8ee5-83a3ba7ae654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (7b9bce6c-c605-4773-8d5e-b747d4c65fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-28007c3a-3e65-442a-bfc5-d67c16adb548 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created volume successfully. Jul 25 02:42:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-d7d071ae-eccd-443e-9948-e1868f88e1e3 req-2b915fe6-0eb2-471f-9fc3-eb0d8a46ea42 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-d7d071ae-eccd-443e-9948-e1868f88e1e3 req-2b915fe6-0eb2-471f-9fc3-eb0d8a46ea42 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-d7d071ae-eccd-443e-9948-e1868f88e1e3 req-2b915fe6-0eb2-471f-9fc3-eb0d8a46ea42 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-d7d071ae-eccd-443e-9948-e1868f88e1e3 req-2b915fe6-0eb2-471f-9fc3-eb0d8a46ea42 tempest-AttachVolumeNegativeTest-1300142540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-ccd2e07f-0000-4837-8962-4fa398ba0b28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99f76424-a340-46c5-9261-8cf9ebfd650b', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:42:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-d7d071ae-eccd-443e-9948-e1868f88e1e3 req-2b915fe6-0eb2-471f-9fc3-eb0d8a46ea42 tempest-AttachVolumeNegativeTest-1300142540 None] attachment_update completed successfully. Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (46db68c9-c6dc-419b-a41f-f6a455055376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39b82c8-d02a-46e8-987e-6dd66bc9ab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39b82c8-d02a-46e8-987e-6dd66bc9ab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458499736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bbb28d-1c51-4c2f-b8a4-92055435b0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:41Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47c78d1-a505-4bcb-92e8-455892ed708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47c78d1-a505-4bcb-92e8-455892ed708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeda5513-3540-45cc-8acc-39b5f8c0a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeda5513-3540-45cc-8acc-39b5f8c0a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23bbb28d-1c51-4c2f-b8a4-92055435b0bb', 'volume_name': 'volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75199a7d-a27c-410f-815a-fdbbbc110aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75199a7d-a27c-410f-815a-fdbbbc110aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cbf717-0a85-4a8a-b10c-235f9af0ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume 23bbb28d-1c51-4c2f-b8a4-92055435b0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb', 'volume_size': 1} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458499736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bbb28d-1c51-4c2f-b8a4-92055435b0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:41Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Creating volume 23bbb28d-1c51-4c2f-b8a4-92055435b0bb {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:41 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:41 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb 1073741824 Jul 25 02:42:41 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (0f5a9b0a-21c2-4bba-bde7-9de751f935e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c6da82-bcb3-412b-b5e9-2977b58812d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c6da82-bcb3-412b-b5e9-2977b58812d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574029517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4461ab23-3d50-4b43-8ea2-4ece3d7a699f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:42Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de4087-c744-4d66-8b19-1536b75fd84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de4087-c744-4d66-8b19-1536b75fd84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93083a2f-d0e7-4d8c-9cdf-ee08ef264caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93083a2f-d0e7-4d8c-9cdf-ee08ef264caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4461ab23-3d50-4b43-8ea2-4ece3d7a699f', 'volume_name': 'volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d05ecd-eaa9-45ed-827f-951122fc3f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d05ecd-eaa9-45ed-827f-951122fc3f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230015cd-157c-4d72-95d1-bececc53cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume 4461ab23-3d50-4b43-8ea2-4ece3d7a699f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f', 'volume_size': 1} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:41 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb 1073741824" returned: 0 in 0.603s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:41 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb Jul 25 02:42:41 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (5fa0d1f0-bda7-4040-87fb-0d58adcd156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4022e2c7-4163-4341-93a7-92254bc5bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4022e2c7-4163-4341-93a7-92254bc5bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622720141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc1618f-d805-4f5c-8b95-6799e1e092ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:42Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ac695-6b1c-4fbf-8c05-e7a4737df3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ac695-6b1c-4fbf-8c05-e7a4737df3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ab595a-22d8-48b3-a696-6a3d235dd2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ab595a-22d8-48b3-a696-6a3d235dd2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc1618f-d805-4f5c-8b95-6799e1e092ac', 'volume_name': 'volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82db7dc5-8778-40ac-a8e5-ba611d7936d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82db7dc5-8778-40ac-a8e5-ba611d7936d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e97e3e-81c0-4965-8ded-71aaba636481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume 1dc1618f-d805-4f5c-8b95-6799e1e092ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac', 'volume_size': 1} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb" returned: 0 in 0.487s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574029517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4461ab23-3d50-4b43-8ea2-4ece3d7a699f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:42Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Creating volume 4461ab23-3d50-4b43-8ea2-4ece3d7a699f {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:42 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cbf717-0a85-4a8a-b10c-235f9af0ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844d87a6-2bca-43e6-982d-ebcced2f050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f 1073741824 Jul 25 02:42:42 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:42 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb (23bbb28d-1c51-4c2f-b8a4-92055435b0bb): created successfully Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844d87a6-2bca-43e6-982d-ebcced2f050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (46db68c9-c6dc-419b-a41f-f6a455055376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:42 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-03e796a6-fcc2-4775-a0af-fabb65d33e21 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created volume successfully. Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (ccf8107c-b4de-4a92-8db4-2e7be506123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e3f92-083d-4736-9bab-4f456a4c2a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e3f92-083d-4736-9bab-4f456a4c2a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-657895346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c735dc3c-85ba-46bd-b36d-db30f2b4f879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:43Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6011774e-a2fc-47d3-9f20-980b023c004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6011774e-a2fc-47d3-9f20-980b023c004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29bd5a6-fd0f-48f3-abea-5282a4348f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29bd5a6-fd0f-48f3-abea-5282a4348f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c735dc3c-85ba-46bd-b36d-db30f2b4f879', 'volume_name': 'volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64378c9e-95fa-4801-bbcf-37fd88fed3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64378c9e-95fa-4801-bbcf-37fd88fed3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5153f3fb-0554-4acb-87cf-119bbe1b3462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:42 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume c735dc3c-85ba-46bd-b36d-db30f2b4f879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879', 'volume_size': 1} Jul 25 02:42:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:43 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f 1073741824" returned: 0 in 0.680s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:43 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f Jul 25 02:42:43 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (e122a752-8d44-4562-a269-98206944ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8966e6a3-0e72-4f5d-b0b4-1e62f786667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8966e6a3-0e72-4f5d-b0b4-1e62f786667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165784994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f01b0c-0bf5-4274-a548-4ae5032667f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:43Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7271294e-702a-4538-878b-4c41bcf6fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7271294e-702a-4538-878b-4c41bcf6fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3289df3b-534b-44be-a8d1-8cf878559540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3289df3b-534b-44be-a8d1-8cf878559540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f01b0c-0bf5-4274-a548-4ae5032667f2', 'volume_name': 'volume-83f01b0c-0bf5-4274-a548-4ae5032667f2', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e20786-2fe8-4f24-a297-2baa6ca90aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e20786-2fe8-4f24-a297-2baa6ca90aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdbc71a-7483-4c4b-90dd-97a477339dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:43 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume 83f01b0c-0bf5-4274-a548-4ae5032667f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f01b0c-0bf5-4274-a548-4ae5032667f2', 'volume_size': 1} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:43 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f" returned: 0 in 0.328s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622720141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc1618f-d805-4f5c-8b95-6799e1e092ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:42Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Creating volume 1dc1618f-d805-4f5c-8b95-6799e1e092ac {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:43 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:43 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac 1073741824 Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230015cd-157c-4d72-95d1-bececc53cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:43 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3b11ef-c416-4e9c-a5f9-9180fa2b7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:43 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f (4461ab23-3d50-4b43-8ea2-4ece3d7a699f): created successfully Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3b11ef-c416-4e9c-a5f9-9180fa2b7a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (0f5a9b0a-21c2-4bba-bde7-9de751f935e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:43 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e4cf62e8-2e63-4a9c-b57c-597801677088 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created volume successfully. Jul 25 02:42:44 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-67fc0dcf-a1a1-4602-b53e-e59be4e19638 req-a68eb1c2-0e78-4672-aeac-6e2e3e97dc8d tempest-AttachVolumeNegativeTest-1300142540 None] Terminate volume connection completed successfully. Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-67fc0dcf-a1a1-4602-b53e-e59be4e19638 req-a68eb1c2-0e78-4672-aeac-6e2e3e97dc8d tempest-AttachVolumeNegativeTest-1300142540 None] Deleting attachment 99f76424-a340-46c5-9261-8cf9ebfd650b. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac 1073741824" returned: 0 in 0.572s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:44 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac Jul 25 02:42:44 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:44 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac" returned: 0 in 0.276s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-657895346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c735dc3c-85ba-46bd-b36d-db30f2b4f879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:43Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Creating volume c735dc3c-85ba-46bd-b36d-db30f2b4f879 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:44 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e97e3e-81c0-4965-8ded-71aaba636481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6a4703-3d4c-40fc-88a4-c79b5fb91987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:44 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 1073741824 Jul 25 02:42:44 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac (1dc1618f-d805-4f5c-8b95-6799e1e092ac): created successfully Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6a4703-3d4c-40fc-88a4-c79b5fb91987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (5fa0d1f0-bda7-4040-87fb-0d58adcd156f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9847b677-ccfe-4648-9e07-0b8e8ec7f09f tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created volume successfully. Jul 25 02:42:44 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 1073741824" returned: 0 in 0.568s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:45 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 Jul 25 02:42:45 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:45 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879" returned: 0 in 0.443s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165784994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f01b0c-0bf5-4274-a548-4ae5032667f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8c2e2f031b4265b5883f6b854ac17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:43Z,use_quota=True,user_id='c695c8754db7457480d8c305a11692fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Creating volume 83f01b0c-0bf5-4274-a548-4ae5032667f2 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:45 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:45 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 1073741824 Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5153f3fb-0554-4acb-87cf-119bbe1b3462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:45 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1ab903-96b9-451e-9ade-018c2260ca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 (c735dc3c-85ba-46bd-b36d-db30f2b4f879): created successfully Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1ab903-96b9-451e-9ade-018c2260ca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (ccf8107c-b4de-4a92-8db4-2e7be506123d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9ba6940e-6fbb-4210-a440-c800f8f17d01 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created volume successfully. Jul 25 02:42:46 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 1073741824" returned: 0 in 0.593s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:46 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 Jul 25 02:42:46 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:46 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2" returned: 0 in 0.325s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdbc71a-7483-4c4b-90dd-97a477339dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f01b0c-0bf5-4274-a548-4ae5032667f2', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cdbfed-aafd-456c-877d-683f7553e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:46 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Volume volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 (83f01b0c-0bf5-4274-a548-4ae5032667f2): created successfully Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cdbfed-aafd-456c-877d-683f7553e794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Flow 'volume_create_manager' (e122a752-8d44-4562-a269-98206944ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a46f7430-167d-4e95-8e8d-e53c64d7dc59 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created volume successfully. Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-83f01b0c-0bf5-4274-a548-4ae5032667f2-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-83f01b0c-0bf5-4274-a548-4ae5032667f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-quobyte-83f01b0c-0bf5-4274-a548-4ae5032667f2" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-83f01b0c-0bf5-4274-a548-4ae5032667f2" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[04288003-b3dc-4e68-bae3-c45ed31c5e05]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:47 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 Jul 25 02:42:47 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:47 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2" returned: 0 in 0.599s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:47 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2 Jul 25 02:42:47 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:47 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-83f01b0c-0bf5-4274-a548-4ae5032667f2" returned: 0 in 0.286s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-83f01b0c-0bf5-4274-a548-4ae5032667f2" released by "delete_volume" :: held 0.951s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created reservations ['7445ed27-013b-4cd1-8c1b-d56ddfd277f6', '468b7c69-ab67-49d1-8528-49b7967225ac', '7398c362-020e-447d-94f4-c6563dfb1362', '064866f7-36ba-4317-a0d2-fb5c2258c108'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:47 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:47 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:48 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.312s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:48 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Deleted volume successfully. Jul 25 02:42:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2fc9fc61-4534-47b0-adda-99b6e96994d8 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-83f01b0c-0bf5-4274-a548-4ae5032667f2-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-c735dc3c-85ba-46bd-b36d-db30f2b4f879-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-c735dc3c-85ba-46bd-b36d-db30f2b4f879-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-quobyte-c735dc3c-85ba-46bd-b36d-db30f2b4f879" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-c735dc3c-85ba-46bd-b36d-db30f2b4f879" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6b7f36-6ea1-43bc-8ed4-48de6251c8ca]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "cinder-ccd2e07f-0000-4837-8962-4fa398ba0b28-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-ccd2e07f-0000-4837-8962-4fa398ba0b28-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:49 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 Jul 25 02:42:49 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "cinder-quobyte-ccd2e07f-0000-4837-8962-4fa398ba0b28" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-quobyte-ccd2e07f-0000-4837-8962-4fa398ba0b28" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5916b5f7-e6ee-4992-8090-568dacad65d0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:49 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 Jul 25 02:42:49 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:49 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879" returned: 0 in 0.431s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:49 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879 Jul 25 02:42:49 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:49 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28" returned: 0 in 0.407s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:49 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28 Jul 25 02:42:49 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:49 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c735dc3c-85ba-46bd-b36d-db30f2b4f879" returned: 0 in 0.334s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-c735dc3c-85ba-46bd-b36d-db30f2b4f879" released by "delete_volume" :: held 0.825s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:49 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created reservations ['62aad593-3692-4991-a143-a3089c581722', 'b5b54034-7206-4f58-b41b-01ba732ae850', 'b01a26cb-a691-41ef-84ca-c26576187984', '1cf04f0f-4638-4461-8742-4f5b3e95f947'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:50 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ccd2e07f-0000-4837-8962-4fa398ba0b28" returned: 0 in 0.296s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-quobyte-ccd2e07f-0000-4837-8962-4fa398ba0b28" released by "delete_volume" :: held 0.764s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:50 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:50 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Created reservations ['8b602c7b-960a-4fda-aaf8-f600bcfad31a', '276dbc7c-4c78-4395-92d5-fbe0606828c7', '077dcb55-42c2-44f4-967a-ce15c2702c26', 'a5e1932b-d398-4cc4-9043-0318459b2ebf'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-1dc1618f-d805-4f5c-8b95-6799e1e092ac-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-1dc1618f-d805-4f5c-8b95-6799e1e092ac-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:50 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:50 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-quobyte-1dc1618f-d805-4f5c-8b95-6799e1e092ac" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:50 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-1dc1618f-d805-4f5c-8b95-6799e1e092ac" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.429s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Deleted volume successfully. Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d781bb66-e5c6-4850-a73c-8fe57668a165]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2e8b1642-5641-48ef-ad0f-7b35e151b97b tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-c735dc3c-85ba-46bd-b36d-db30f2b4f879-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "cinder-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=176,cinder:SELECT=142,cinder:INSERT=38,cinder:DELETE=16 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "cinder-quobyte-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-quobyte-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:50 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:50 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:50 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[48593708-6bf3-449a-95fe-70a45692c1ce]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:50 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:50 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.511s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Deleted volume successfully. Jul 25 02:42:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b9db854f-f4c6-415c-81c1-57cd76c54aa8 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-ccd2e07f-0000-4837-8962-4fa398ba0b28-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:51 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 Jul 25 02:42:51 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:51 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac" returned: 0 in 0.660s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:51 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac Jul 25 02:42:51 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:51 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.457s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:42:51 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65" returned: 0 in 0.523s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:51 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65 Jul 25 02:42:51 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:51 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1dc1618f-d805-4f5c-8b95-6799e1e092ac" returned: 0 in 0.344s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-1dc1618f-d805-4f5c-8b95-6799e1e092ac" released by "delete_volume" :: held 1.104s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created reservations ['c2247290-efe8-4cf6-af78-c76804e645e4', '29924eeb-4043-4b56-9f86-3b8cd750f055', 'd8dabd9a-6b3f-46e6-b69f-be3abf11bba8', 'd18e919a-69c9-45ad-bb51-27e32dde4e84'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:51 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65" returned: 0 in 0.344s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-quobyte-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65" released by "delete_volume" :: held 0.974s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:51 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:51 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Created reservations ['6594fac7-c945-4ce9-81b9-a75b9e78ca2b', '7aa36833-3b81-441c-9d73-e2dbd73773a3', '43b9ac0f-7138-4db2-9eb3-a282def61f61', '40f45178-c723-41b4-ab69-334693d7b0b0'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:52 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:52 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:52 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.419s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Deleted volume successfully. Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ab4133eb-468a-4f42-8f68-d41dc232cacc tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-1dc1618f-d805-4f5c-8b95-6799e1e092ac-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:52 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Deleted volume successfully. Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-195aefae-948b-4eff-9bc5-c3ba1a5bb692 tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-a80cd44a-b836-4b1b-bc1e-beb5f66a1d65-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-4461ab23-3d50-4b43-8ea2-4ece3d7a699f-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-4461ab23-3d50-4b43-8ea2-4ece3d7a699f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-quobyte-4461ab23-3d50-4b43-8ea2-4ece3d7a699f" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-4461ab23-3d50-4b43-8ea2-4ece3d7a699f" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0386230-3817-426e-afc6-4863515f44b7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:52 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f Jul 25 02:42:52 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:53 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f" returned: 0 in 0.395s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:53 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f Jul 25 02:42:53 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "cinder-070b9683-f3e3-4392-ac77-77b5d75cef63-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-070b9683-f3e3-4392-ac77-77b5d75cef63-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "cinder-quobyte-070b9683-f3e3-4392-ac77-77b5d75cef63" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-quobyte-070b9683-f3e3-4392-ac77-77b5d75cef63" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2746421f-8ee8-4eea-80bf-4ad4dcdc6564]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:53 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4461ab23-3d50-4b43-8ea2-4ece3d7a699f" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-4461ab23-3d50-4b43-8ea2-4ece3d7a699f" released by "delete_volume" :: held 0.718s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:53 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 Jul 25 02:42:53 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created reservations ['12aade11-d245-429d-997c-61d3a48b2d48', '5fd976a9-88ea-4922-b071-0b6b887043d8', 'c8e1d361-95e7-4cbd-b0c3-04ce905910fa', '01d593f1-df0e-4155-87ce-530c49acefcf'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:53 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:53 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:53 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63" returned: 0 in 0.451s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-23bbb28d-1c51-4c2f-b8a4-92055435b0bb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:53 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:53 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63 Jul 25 02:42:53 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.309s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-23bbb28d-1c51-4c2f-b8a4-92055435b0bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:53 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Deleted volume successfully. Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=192,cinder:SELECT=151,cinder:INSERT=48,cinder:DELETE=17 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2018eae5-10c1-4220-ac43-22c990362734 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-4461ab23-3d50-4b43-8ea2-4ece3d7a699f-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-quobyte-23bbb28d-1c51-4c2f-b8a4-92055435b0bb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-23bbb28d-1c51-4c2f-b8a4-92055435b0bb" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24dbc45-7661-45c0-b929-355c8bc092ef]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:54 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb Jul 25 02:42:54 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:54 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-070b9683-f3e3-4392-ac77-77b5d75cef63" returned: 0 in 0.329s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-quobyte-070b9683-f3e3-4392-ac77-77b5d75cef63" released by "delete_volume" :: held 0.828s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Created reservations ['aaefac51-e747-45ef-b4e3-92c8cb129c14', 'c64fd529-58dc-449d-82b0-88a9771cddac', '84074a87-bc5d-492e-9116-6351853859f4', 'c77778e7-4647-4231-a89a-9d83d2b44541'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:54 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:54 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:54 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb" returned: 0 in 0.435s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:54 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb Jul 25 02:42:54 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:54 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.309s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Deleted volume successfully. Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-05efa0bb-103d-4917-9aad-7f82c17dd3eb tempest-AttachVolumeNegativeTest-1300142540 None] Lock "cinder-070b9683-f3e3-4392-ac77-77b5d75cef63-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:54 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-23bbb28d-1c51-4c2f-b8a4-92055435b0bb" returned: 0 in 0.342s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-23bbb28d-1c51-4c2f-b8a4-92055435b0bb" released by "delete_volume" :: held 0.834s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created reservations ['8b4e25fa-ddc6-4aba-82a0-777c159566ae', 'd1856960-076a-4bd4-b477-0afa5b49e144', '52acc1a0-b31a-4c35-a622-682b957982fe', '2954124d-b383-4b87-ad1a-7b0483a7ded4'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:54 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:54 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:55 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:55 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Deleted volume successfully. Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb680749-3763-415b-addf-db0713dfcc9d tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-23bbb28d-1c51-4c2f-b8a4-92055435b0bb-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-2cc49d48-fc42-4643-9616-4f3651a2fc15-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-2cc49d48-fc42-4643-9616-4f3651a2fc15-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "cinder-quobyte-2cc49d48-fc42-4643-9616-4f3651a2fc15" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-2cc49d48-fc42-4643-9616-4f3651a2fc15" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eae4bc-5f0a-47fa-aa0f-d16a34d58344]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:55 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 Jul 25 02:42:55 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:55 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15" returned: 0 in 0.427s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:55 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15 Jul 25 02:42:55 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:56 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2cc49d48-fc42-4643-9616-4f3651a2fc15" returned: 0 in 0.303s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-quobyte-2cc49d48-fc42-4643-9616-4f3651a2fc15" released by "delete_volume" :: held 0.784s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Created reservations ['004414f3-54fb-406c-a594-f1b17e8bebeb', '33c4c332-1185-4b13-a9cf-9a670c055583', '2f424dbe-7ecf-47bf-ad15-5cf0a3a6b614', '562f8e5a-d0e7-46e8-a930-8fdcb98a8b47'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:56 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:42:56 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:56 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:42:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Deleted volume successfully. Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Flow 'volume_create_manager' (de68c0c7-adfd-4c02-8e89-f82a7dad4c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79985bd7-f423-474f-bbed-8380981772f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79985bd7-f423-474f-bbed-8380981772f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-988638987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a726125-1e60-4135-90bf-5a53014f446f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749712ed9cc5493da2caa961fd32d124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:57Z,use_quota=True,user_id='b060ecc6f5cb4c3fbde1cbdab614a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e69c43fa-4dd7-41d6-95d6-87f9b9fd2064),volume_type_id=e69c43fa-4dd7-41d6-95d6-87f9b9fd2064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071f81de-641f-44d4-964b-3b2dedb3be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071f81de-641f-44d4-964b-3b2dedb3be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b435e87-c89b-400b-91c8-591e224d4c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b435e87-c89b-400b-91c8-591e224d4c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a726125-1e60-4135-90bf-5a53014f446f', 'volume_name': 'volume-4a726125-1e60-4135-90bf-5a53014f446f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc3832b-324b-4f27-8d26-5d56fd7ffcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc3832b-324b-4f27-8d26-5d56fd7ffcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab53e37-3f30-4fab-ae25-5379e0a9c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:56 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume 4a726125-1e60-4135-90bf-5a53014f446f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a726125-1e60-4135-90bf-5a53014f446f', 'volume_size': 1} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-988638987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a726125-1e60-4135-90bf-5a53014f446f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749712ed9cc5493da2caa961fd32d124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:57Z,use_quota=True,user_id='b060ecc6f5cb4c3fbde1cbdab614a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e69c43fa-4dd7-41d6-95d6-87f9b9fd2064),volume_type_id=e69c43fa-4dd7-41d6-95d6-87f9b9fd2064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Creating volume 4a726125-1e60-4135-90bf-5a53014f446f {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:56 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-7053dca5-9ead-4ed7-affa-9d485a61efc5 tempest-CreateVolumesFromSourceVolumeTest-466018920 None] Lock "cinder-2cc49d48-fc42-4643-9616-4f3651a2fc15-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:42:56 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f 1073741824 Jul 25 02:42:56 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Flow 'volume_create_manager' (111d8124-1a0a-415a-812a-750e84f4eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8445723-b3ae-4be1-9e28-be1ca0d049b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8445723-b3ae-4be1-9e28-be1ca0d049b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1823172161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996ddab-3ab6-4bc5-a233-37ceac2acb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749712ed9cc5493da2caa961fd32d124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:57Z,use_quota=True,user_id='b060ecc6f5cb4c3fbde1cbdab614a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20addda0-b434-416b-9d46-6c80aea1216a),volume_type_id=20addda0-b434-416b-9d46-6c80aea1216a)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4e3b03-ca0c-41bf-b78d-84c47ea82c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4e3b03-ca0c-41bf-b78d-84c47ea82c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2006b16b-4ab0-4314-b9b2-5b2ba28fe68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2006b16b-4ab0-4314-b9b2-5b2ba28fe68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0996ddab-3ab6-4bc5-a233-37ceac2acb1e', 'volume_name': 'volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a72183-7857-48ff-8dfd-40c9913bf0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a72183-7857-48ff-8dfd-40c9913bf0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be06f5e8-eef3-43e3-afc0-3783f6723a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:57 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume 0996ddab-3ab6-4bc5-a233-37ceac2acb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e', 'volume_size': 1} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:57 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f 1073741824" returned: 0 in 0.835s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:57 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f Jul 25 02:42:57 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:58 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f" returned: 0 in 0.340s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1823172161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996ddab-3ab6-4bc5-a233-37ceac2acb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749712ed9cc5493da2caa961fd32d124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:57Z,use_quota=True,user_id='b060ecc6f5cb4c3fbde1cbdab614a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20addda0-b434-416b-9d46-6c80aea1216a),volume_type_id=20addda0-b434-416b-9d46-6c80aea1216a)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Creating volume 0996ddab-3ab6-4bc5-a233-37ceac2acb1e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:42:58 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:42:58 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e 1073741824 Jul 25 02:42:58 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Flow 'volume_create_manager' (d1b057b1-2fe3-4947-ac1d-12083b50404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b958cba-1243-40cc-9db7-a42e08b1480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab53e37-3f30-4fab-ae25-5379e0a9c560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a726125-1e60-4135-90bf-5a53014f446f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09876dd1-6f37-44ad-8e89-dd81e8f48b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b958cba-1243-40cc-9db7-a42e08b1480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1029596009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b7148-b6d1-41ee-b00b-0dff5ae7fdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749712ed9cc5493da2caa961fd32d124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:58Z,use_quota=True,user_id='b060ecc6f5cb4c3fbde1cbdab614a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5352c1cc-bbc7-419a-9aa9-d0d53263c073),volume_type_id=5352c1cc-bbc7-419a-9aa9-d0d53263c073)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8135fd5-1745-4c51-9d22-36d7ec89d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8135fd5-1745-4c51-9d22-36d7ec89d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb70e42b-4e2f-4263-b3eb-f04c98cfa8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:42:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume volume-4a726125-1e60-4135-90bf-5a53014f446f (4a726125-1e60-4135-90bf-5a53014f446f): created successfully Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09876dd1-6f37-44ad-8e89-dd81e8f48b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Flow 'volume_create_manager' (de68c0c7-adfd-4c02-8e89-f82a7dad4c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6d2afe1b-8592-421e-beef-dbab7d382c43 tempest-TestInstancesWithCinderVolumes-392406290 None] Created volume successfully. Jul 25 02:42:58 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e 1073741824" returned: 0 in 0.680s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb70e42b-4e2f-4263-b3eb-f04c98cfa8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '063b7148-b6d1-41ee-b00b-0dff5ae7fdbc', 'volume_name': 'volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc', 'volume_size': 1, 'image_id': 'ba2622d5-74ee-405f-974a-18182675829e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba2622d5-74ee-405f-974a-18182675829e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--275969835', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '749712ed9cc5493da2caa961fd32d124', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba2622d5-74ee-405f-974a-18182675829e', 'created_at': datetime.datetime(2026, 7, 25, 0, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba2622d5-74ee-405f-974a-18182675829e/file', 'properties': {}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4524264b-6385-40ce-ac76-8d70cb1545c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:59 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e Jul 25 02:42:59 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4524264b-6385-40ce-ac76-8d70cb1545c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07ebf55-22b0-491e-8261-a8c0da886675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc', 'volume_size': 1, 'image_id': 'ba2622d5-74ee-405f-974a-18182675829e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba2622d5-74ee-405f-974a-18182675829e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--275969835', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '749712ed9cc5493da2caa961fd32d124', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba2622d5-74ee-405f-974a-18182675829e', 'created_at': datetime.datetime(2026, 7, 25, 0, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba2622d5-74ee-405f-974a-18182675829e/file', 'properties': {}}, 'image_service': } Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Trying to clone 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc from image ba2622d5-74ee-405f-974a-18182675829e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba2622d5-74ee-405f-974a-18182675829e', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:42:59 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be06f5e8-eef3-43e3-afc0-3783f6723a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411ca32c-deab-4b49-a1af-2fd3683698d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:42:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e (0996ddab-3ab6-4bc5-a233-37ceac2acb1e): created successfully Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411ca32c-deab-4b49-a1af-2fd3683698d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:42:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Flow 'volume_create_manager' (111d8124-1a0a-415a-812a-750e84f4eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:42:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9a2f7e74-b9e3-4ff6-a8d8-192ecef212a4 tempest-TestInstancesWithCinderVolumes-392406290 None] Created volume successfully. Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Flow 'volume_create_manager' (8166c0a0-9323-4adf-8cc5-ea4b8fb274b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aec7899-b8e6-451d-b280-6698a6e33d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aec7899-b8e6-451d-b280-6698a6e33d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411b60ef63bb4d02bd9c196d9e1d725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:01Z,use_quota=True,user_id='bbc579b74d1149abbf6ae24f81e14d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354d2068-78b2-4bb9-bad8-8a7c1791362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354d2068-78b2-4bb9-bad8-8a7c1791362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee0ca96-247d-4ec0-b28c-292d2f4802a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee0ca96-247d-4ec0-b28c-292d2f4802a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe', 'volume_name': 'volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc61878-cbab-49f7-a8fe-4f68154306d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc61878-cbab-49f7-a8fe-4f68154306d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaf87ce-67a4-4263-b114-7162de8727bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Volume 891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe', 'volume_size': 1} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411b60ef63bb4d02bd9c196d9e1d725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:01Z,use_quota=True,user_id='bbc579b74d1149abbf6ae24f81e14d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Creating volume 891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:01 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:01 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe 1073741824 Jul 25 02:43:01 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:01 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe 1073741824" returned: 0 in 0.485s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:01 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe Jul 25 02:43:01 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:02 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe" returned: 0 in 0.282s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaf87ce-67a4-4263-b114-7162de8727bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50767b1-df44-44b1-ae52-9eff089a3657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Volume volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe (891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe): created successfully Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50767b1-df44-44b1-ae52-9eff089a3657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Flow 'volume_create_manager' (8166c0a0-9323-4adf-8cc5-ea4b8fb274b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:02 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ed903751-b931-4b62-b8e7-9ba08b7d8410 tempest-CinderUnicodeTest-1630516315 None] Created volume successfully. Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Flow 'volume_create_manager' (67515b3d-19e3-41b9-9d6a-cb4b7117ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b576b1f5-773d-4fe9-a9e9-936cc25e7cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b576b1f5-773d-4fe9-a9e9-936cc25e7cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1025619047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ab41fbf04430a9ee84a9b814a7dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:03Z,use_quota=True,user_id='6575d55c5d7d4bd3ab2f54080a3c1663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4274bdec-093b-44da-bd45-a3f51a5477b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4274bdec-093b-44da-bd45-a3f51a5477b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619a102c-aa0d-470c-b048-1df63f432338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619a102c-aa0d-470c-b048-1df63f432338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1', 'volume_name': 'volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48548489-6ae4-426b-8368-5f547f1d560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48548489-6ae4-426b-8368-5f547f1d560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b3809a-dbec-4341-b05c-8e691c64bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Volume f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1', 'volume_size': 1} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1025619047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ab41fbf04430a9ee84a9b814a7dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:03Z,use_quota=True,user_id='6575d55c5d7d4bd3ab2f54080a3c1663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Creating volume f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:02 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:02 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 1073741824 Jul 25 02:43:02 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD, size 20.69 MB, duration 4.08 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:43:03 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Image download 20.69 MB at 5.07 MB/s Jul 25 02:43:03 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 1073741824" returned: 0 in 0.431s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fb68b-2d0a-4f5c-9588-648757bf343a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:03 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 Jul 25 02:43:03 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:03 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD Jul 25 02:43:03 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:03 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b3809a-dbec-4341-b05c-8e691c64bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e4ed28-c425-44ba-ad46-56ee92905b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:03 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Volume volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 (f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1): created successfully Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e4ed28-c425-44ba-ad46-56ee92905b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Flow 'volume_create_manager' (67515b3d-19e3-41b9-9d6a-cb4b7117ef08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Temporary image ba2622d5-74ee-405f-974a-18182675829e is fetched for user b060ecc6f5cb4c3fbde1cbdab614a486. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:43:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d72d188d-21ac-4257-b920-f671804fc31b tempest-VolumesTestJSON-195848994 None] Created volume successfully. Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[98072e5d-1d60-4221-adbd-d3ddb0ef443c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:03 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD Jul 25 02:43:03 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Flow 'volume_create_manager' (d962ecc5-98c7-4b3b-a6c0-8fd5162560e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963b123a-b801-4127-9579-334191a434a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963b123a-b801-4127-9579-334191a434a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-755091462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3f1e02-2b99-415b-9928-4cf927fa60e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411b60ef63bb4d02bd9c196d9e1d725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:04Z,use_quota=True,user_id='bbc579b74d1149abbf6ae24f81e14d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc3222d-87d3-4db2-8b1a-a8142a058248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc3222d-87d3-4db2-8b1a-a8142a058248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7b876e-217b-4791-8883-f35ffb69f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7b876e-217b-4791-8883-f35ffb69f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3f1e02-2b99-415b-9928-4cf927fa60e4', 'volume_name': 'volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27644998-e9ce-4823-8ba2-d82e38b2c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27644998-e9ce-4823-8ba2-d82e38b2c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ab908e-48ca-49fc-acbe-a3b3897ec79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Volume cb3f1e02-2b99-415b-9928-4cf927fa60e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4', 'volume_size': 1} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-755091462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3f1e02-2b99-415b-9928-4cf927fa60e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411b60ef63bb4d02bd9c196d9e1d725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:04Z,use_quota=True,user_id='bbc579b74d1149abbf6ae24f81e14d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Creating volume cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:03 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:03 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 1073741824 Jul 25 02:43:03 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:03 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Flow 'volume_create_manager' (1ef5621b-583d-4970-933e-84ebceb69d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9606d9c2-a762-4d19-8569-b3b34563ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9606d9c2-a762-4d19-8569-b3b34563ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-699509141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e26761-9074-4086-9311-8de34359a9cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ab41fbf04430a9ee84a9b814a7dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:04Z,use_quota=True,user_id='6575d55c5d7d4bd3ab2f54080a3c1663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c168d084-c326-4e70-aec5-b29d19bb7c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c168d084-c326-4e70-aec5-b29d19bb7c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e85021a-d05e-43f6-9086-2a4c2ef548a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e85021a-d05e-43f6-9086-2a4c2ef548a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e26761-9074-4086-9311-8de34359a9cb', 'volume_name': 'volume-d1e26761-9074-4086-9311-8de34359a9cb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84135e4-174d-46c6-9744-840f83f57620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84135e4-174d-46c6-9744-840f83f57620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd982359-8988-4221-b9ee-193376a67989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Volume d1e26761-9074-4086-9311-8de34359a9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e26761-9074-4086-9311-8de34359a9cb', 'volume_size': 1} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:04 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 1073741824" returned: 0 in 0.451s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:04 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 Jul 25 02:43:04 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:04 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4" returned: 0 in 0.248s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1029596009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b7148-b6d1-41ee-b00b-0dff5ae7fdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749712ed9cc5493da2caa961fd32d124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:42:58Z,use_quota=True,user_id='b060ecc6f5cb4c3fbde1cbdab614a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5352c1cc-bbc7-419a-9aa9-d0d53263c073),volume_type_id=5352c1cc-bbc7-419a-9aa9-d0d53263c073)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Creating volume 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:04 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:04 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc 1073741824 Jul 25 02:43:04 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ab908e-48ca-49fc-acbe-a3b3897ec79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfabb68-0cc9-45b4-bf20-12b37d358e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Volume volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 (cb3f1e02-2b99-415b-9928-4cf927fa60e4): created successfully Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfabb68-0cc9-45b4-bf20-12b37d358e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Flow 'volume_create_manager' (d962ecc5-98c7-4b3b-a6c0-8fd5162560e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f7bcb0c2-f62f-448e-a1ef-4396c3cf704d tempest-CinderUnicodeTest-1630516315 None] Created volume successfully. Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:05 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc 1073741824" returned: 0 in 0.478s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:05 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc Jul 25 02:43:05 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:05 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-699509141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e26761-9074-4086-9311-8de34359a9cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ab41fbf04430a9ee84a9b814a7dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:04Z,use_quota=True,user_id='6575d55c5d7d4bd3ab2f54080a3c1663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Creating volume d1e26761-9074-4086-9311-8de34359a9cb {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:05 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:05 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb 1073741824 Jul 25 02:43:05 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Attempting download of ba2622d5-74ee-405f-974a-18182675829e ((None, [{'url': 'file:///opt/stack/data/glance/images/ba2622d5-74ee-405f-974a-18182675829e', 'metadata': {}}])) to volume 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6723de12-5010-4b3d-b73a-d06d260da1f6]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:05 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1 Jul 25 02:43:05 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:05 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:05 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1" returned: 0 in 0.367s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb 1073741824" returned: 0 in 0.459s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:05 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb Jul 25 02:43:05 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:06 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1 Jul 25 02:43:06 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:06 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb" returned: 0 in 0.260s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.120s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd982359-8988-4221-b9ee-193376a67989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e26761-9074-4086-9311-8de34359a9cb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca14187-63f3-414f-8d9e-7f135871a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Creating offline snapshot 57fe3cdb-40a2-43bc-82f7-543dc6b69112 of volume cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:43:06 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1" returned: 1 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba2622d5-74ee-405f-974a-18182675829e_ptffire1' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffcd6a0-2c73-4de4-a83b-d0cce00ce849]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321f4ba-a0c4-4762-81cb-09e086e425f4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:06 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Volume volume-d1e26761-9074-4086-9311-8de34359a9cb (d1e26761-9074-4086-9311-8de34359a9cb): created successfully Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca14187-63f3-414f-8d9e-7f135871a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Flow 'volume_create_manager' (1ef5621b-583d-4970-933e-84ebceb69d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-efdf93b5-4b44-4290-8af8-63b8d512d164 tempest-VolumesTestJSON-195848994 None] Created volume successfully. Jul 25 02:43:06 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD Jul 25 02:43:06 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:06 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 Jul 25 02:43:06 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:06 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] ba2622d5-74ee-405f-974a-18182675829e was qcow2, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:06 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc Jul 25 02:43:06 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:06 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:06 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 1G Jul 25 02:43:06 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:07 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 1G" returned: 0 in 0.420s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:07 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 Jul 25 02:43:07 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:07 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112" returned: 0 in 0.379s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:07 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 is being set with open permissions: ugo+rw Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:07 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 Jul 25 02:43:07 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:07 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:07 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info Jul 25 02:43:07 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:07 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Flow 'volume_create_manager' (86f6f3b1-a5e7-4336-a68d-a7b1f4f3ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9468d4-08f8-4e28-ab8f-b09405597b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9468d4-08f8-4e28-ab8f-b09405597b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1251082246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b7ef54-943b-4ffb-8b52-11536ddd7677,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ab41fbf04430a9ee84a9b814a7dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:08Z,use_quota=True,user_id='6575d55c5d7d4bd3ab2f54080a3c1663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01df23b6-c38d-459d-9ea3-7d4a6d17c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01df23b6-c38d-459d-9ea3-7d4a6d17c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33a3a77-5b0d-4590-b9a5-64c54a999ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33a3a77-5b0d-4590-b9a5-64c54a999ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b7ef54-943b-4ffb-8b52-11536ddd7677', 'volume_name': 'volume-62b7ef54-943b-4ffb-8b52-11536ddd7677', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48889e41-3c25-4857-b12b-de0be8292de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48889e41-3c25-4857-b12b-de0be8292de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1984ac-05d9-4299-8f04-8d8604431b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:08 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Volume 62b7ef54-943b-4ffb-8b52-11536ddd7677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b7ef54-943b-4ffb-8b52-11536ddd7677', 'volume_size': 1} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:08 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:08 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info is being set with open permissions: ugo+rw Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:08 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info Jul 25 02:43:08 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:08 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.info" returned: 0 in 0.259s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1251082246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b7ef54-943b-4ffb-8b52-11536ddd7677,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ab41fbf04430a9ee84a9b814a7dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:08Z,use_quota=True,user_id='6575d55c5d7d4bd3ab2f54080a3c1663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Creating volume 62b7ef54-943b-4ffb-8b52-11536ddd7677 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:08 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:08 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 1073741824 Jul 25 02:43:08 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-39d345f1-2546-4c7a-8123-50d1a4d8365b tempest-CinderUnicodeTest-1630516315 None] Create snapshot completed successfully Jul 25 02:43:08 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" returned: 0 in 1.837s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba2622d5-74ee-405f-974a-18182675829e_akyq72bxdevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:43:08 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Converted 112.00 MB image at 60.93 MB/s Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:08 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc 1G Jul 25 02:43:08 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:08 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc 1G" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Downloaded image ba2622d5-74ee-405f-974a-18182675829e ((None, [{'url': 'file:///opt/stack/data/glance/images/ba2622d5-74ee-405f-974a-18182675829e', 'metadata': {}}])) to volume 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Temporary image ba2622d5-74ee-405f-974a-18182675829e for user b060ecc6f5cb4c3fbde1cbdab614a486 is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Marking volume 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Copying metadata from image ba2622d5-74ee-405f-974a-18182675829e to 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Creating volume glance metadata for volume 063b7148-b6d1-41ee-b00b-0dff5ae7fdbc backed by image ba2622d5-74ee-405f-974a-18182675829e with: {'image_id': 'ba2622d5-74ee-405f-974a-18182675829e', 'image_name': 'tempest-scenario-img--275969835', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:43:08 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 1073741824" returned: 0 in 0.439s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07ebf55-22b0-491e-8261-a8c0da886675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc', 'volume_size': 1, 'image_id': 'ba2622d5-74ee-405f-974a-18182675829e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba2622d5-74ee-405f-974a-18182675829e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--275969835', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '749712ed9cc5493da2caa961fd32d124', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba2622d5-74ee-405f-974a-18182675829e', 'created_at': datetime.datetime(2026, 7, 25, 0, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba2622d5-74ee-405f-974a-18182675829e/file', 'properties': {}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:08 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 Jul 25 02:43:08 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c022a159-025c-498c-bfbd-8b8f64f32c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:08 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Volume volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc (063b7148-b6d1-41ee-b00b-0dff5ae7fdbc): created successfully Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c022a159-025c-498c-bfbd-8b8f64f32c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Flow 'volume_create_manager' (d1b057b1-2fe3-4947-ac1d-12083b50404f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a2b27eb3-fc47-4bb7-a510-30879db8b8a0 tempest-TestInstancesWithCinderVolumes-392406290 None] Created volume successfully. Jul 25 02:43:09 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677" returned: 0 in 0.245s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1984ac-05d9-4299-8f04-8d8604431b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b7ef54-943b-4ffb-8b52-11536ddd7677', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a5918f-b582-4a5c-b949-8b530658344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:09 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Volume volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 (62b7ef54-943b-4ffb-8b52-11536ddd7677): created successfully Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a5918f-b582-4a5c-b949-8b530658344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Flow 'volume_create_manager' (86f6f3b1-a5e7-4336-a68d-a7b1f4f3ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-811fa027-382e-4078-8684-d8e4956acdda tempest-VolumesTestJSON-195848994 None] Created volume successfully. Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-57fe3cdb-40a2-43bc-82f7-543dc6b69112-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-57fe3cdb-40a2-43bc-82f7-543dc6b69112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-quobyte-cb3f1e02-2b99-415b-9928-4cf927fa60e4" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-cb3f1e02-2b99-415b-9928-4cf927fa60e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-quobyte-57fe3cdb-40a2-43bc-82f7-543dc6b69112" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-57fe3cdb-40a2-43bc-82f7-543dc6b69112" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Deleting offline snapshot 57fe3cdb-40a2-43bc-82f7-543dc6b69112 of volume cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] snapshot_file for this snap is: volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7282857-42e5-46a9-8aec-d9b0a88593e6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:09 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 Jul 25 02:43:09 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:09 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112" returned: 0 in 0.368s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1512bda0-e1ed-4069-910a-e16c4e877a54]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:09 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 Jul 25 02:43:09 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:10 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4" returned: 0 in 0.378s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:10 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 Jul 25 02:43:10 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:10 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112" returned: 0 in 0.461s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:10 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112 Jul 25 02:43:10 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:10 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4.57fe3cdb-40a2-43bc-82f7-543dc6b69112" returned: 0 in 0.313s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-57fe3cdb-40a2-43bc-82f7-543dc6b69112" released by "_delete_snapshot" :: held 1.644s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-cb3f1e02-2b99-415b-9928-4cf927fa60e4" released by "delete_snapshot" :: held 1.667s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Acquiring lock "cinder-62b7ef54-943b-4ffb-8b52-11536ddd7677-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Lock "cinder-62b7ef54-943b-4ffb-8b52-11536ddd7677-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Created reservations ['32f225ee-0c59-4496-89f6-4b50e469ba1b', '64610313-a0b4-4bae-a8c8-c6778424cbdc', '5c2df19d-9a1f-4dff-a84a-12fa3e4dfe10', '62586c0a-6e29-407b-8095-db28c9943699'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Acquiring lock "cinder-quobyte-62b7ef54-943b-4ffb-8b52-11536ddd7677" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Lock "cinder-quobyte-62b7ef54-943b-4ffb-8b52-11536ddd7677" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[83060376-d56d-4bb5-add5-96fad03527f7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Delete snapshot completed successfully. Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74e57643-11b0-4fda-a262-72c158eb4b68 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-57fe3cdb-40a2-43bc-82f7-543dc6b69112-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:11 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 Jul 25 02:43:11 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-cb3f1e02-2b99-415b-9928-4cf927fa60e4-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-cb3f1e02-2b99-415b-9928-4cf927fa60e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-quobyte-cb3f1e02-2b99-415b-9928-4cf927fa60e4" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-cb3f1e02-2b99-415b-9928-4cf927fa60e4" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c34a60b-962c-45f7-8c20-239fb380b3b4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:11 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677" returned: 0 in 0.463s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:11 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677 Jul 25 02:43:11 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:11 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 Jul 25 02:43:11 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:11 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-62b7ef54-943b-4ffb-8b52-11536ddd7677" returned: 0 in 0.277s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Lock "cinder-quobyte-62b7ef54-943b-4ffb-8b52-11536ddd7677" released by "delete_volume" :: held 0.789s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Created reservations ['a6665656-ddeb-4f82-bf0a-24df513ccce2', 'fb25d85a-7858-4b0f-8a95-f93a972a46b9', '42dc4dd9-2462-4f96-a188-b003692b4fbc', 'f628dd26-0d05-4a6f-b370-2d6e114f6780'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:12 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4" returned: 0 in 0.469s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:12 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4 Jul 25 02:43:12 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:12 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:12 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Acquiring lock "cinder-d1e26761-9074-4086-9311-8de34359a9cb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Lock "cinder-d1e26761-9074-4086-9311-8de34359a9cb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Acquiring lock "cinder-quobyte-d1e26761-9074-4086-9311-8de34359a9cb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:12 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Lock "cinder-quobyte-d1e26761-9074-4086-9311-8de34359a9cb" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-cb3f1e02-2b99-415b-9928-4cf927fa60e4" returned: 0 in 0.400s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee98b5-7402-4fd3-8902-4d99da9b3036]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-cb3f1e02-2b99-415b-9928-4cf927fa60e4" released by "delete_volume" :: held 0.951s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Created reservations ['43885d03-854c-4c23-897c-8faa7582d545', '4f91300a-ffb2-420e-8097-dbc41b593185', '011eecf5-dd1b-4582-b452-4962dd964085', '3f32649c-c852-4ffb-bd9c-467b6d57ca40'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:12 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.530s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Deleted volume successfully. Jul 25 02:43:12 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb Jul 25 02:43:12 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e255c85e-5ff8-4260-be02-1f51ea75fa49 tempest-VolumesTestJSON-195848994 None] Lock "cinder-62b7ef54-943b-4ffb-8b52-11536ddd7677-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3c3c2698-2884-4747-9965-8441805395dc req-a1d923f2-de8b-476a-bd64-2821fbc65278 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3c3c2698-2884-4747-9965-8441805395dc req-a1d923f2-de8b-476a-bd64-2821fbc65278 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:12 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:12 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-3c3c2698-2884-4747-9965-8441805395dc req-a1d923f2-de8b-476a-bd64-2821fbc65278 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-3c3c2698-2884-4747-9965-8441805395dc req-a1d923f2-de8b-476a-bd64-2821fbc65278 tempest-TestInstancesWithCinderVolumes-392406290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60852538-9b10-45da-abe0-460bd6fa79c6', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:43:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-3c3c2698-2884-4747-9965-8441805395dc req-a1d923f2-de8b-476a-bd64-2821fbc65278 tempest-TestInstancesWithCinderVolumes-392406290 None] attachment_update completed successfully. Jul 25 02:43:13 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb" returned: 0 in 0.497s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:13 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb Jul 25 02:43:13 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:13 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Deleted volume successfully. Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1431244d-3826-4b24-9ec8-380f2aeb1737 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-cb3f1e02-2b99-415b-9928-4cf927fa60e4-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:13 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d1e26761-9074-4086-9311-8de34359a9cb" returned: 0 in 0.408s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Lock "cinder-quobyte-d1e26761-9074-4086-9311-8de34359a9cb" released by "delete_volume" :: held 0.955s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Created reservations ['6de51da8-7de3-482a-bf9a-fadd4fa05bc6', '86987808-d097-4974-a5eb-a2f9170d66b7', '2660542c-6d0d-4b0f-82dc-bda7834ba52f', '4d36c909-cdc4-40a1-9f5a-36256a86bbbc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:13 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:13 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "cinder-quobyte-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:13 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.312s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Deleted volume successfully. Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[19582445-127e-4f7a-a257-3ca9fd044e75]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ad643dc4-c29c-48f3-8d1d-cce3bfa0ef2d tempest-VolumesTestJSON-195848994 None] Lock "cinder-d1e26761-9074-4086-9311-8de34359a9cb-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:14 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe Jul 25 02:43:14 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:14 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe" returned: 0 in 0.382s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:14 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe Jul 25 02:43:14 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:14 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-quobyte-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe" released by "delete_volume" :: held 0.718s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Acquiring lock "cinder-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Lock "cinder-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Created reservations ['299ed88c-1aed-4291-bc3b-eb01776d33ee', '94b9594c-5cc9-40a3-8620-19d0f91391a2', '1c952c58-7b55-40f7-b8cc-9077ded275de', 'f8355380-125e-498b-9fa9-98a990d3cd17'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Acquiring lock "cinder-quobyte-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Lock "cinder-quobyte-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a5d38-84f8-40ee-b244-04914ae2a26c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:14 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:14 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:14 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 Jul 25 02:43:14 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:15 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:15 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Deleted volume successfully. Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-08ce53bb-2662-4228-965b-ddc0508cd3c1 tempest-CinderUnicodeTest-1630516315 None] Lock "cinder-891b7a9b-1ca2-4bdb-a6a4-71b2f26455fe-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:15 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1" returned: 0 in 0.513s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:15 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1 Jul 25 02:43:15 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1" returned: 0 in 0.437s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:15 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Lock "cinder-quobyte-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1" released by "delete_volume" :: held 1.038s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Created reservations ['df42c88e-da59-4119-833a-7a90633a476c', '4b6117a7-1602-4235-b2f5-cf3d87840f23', '5d643070-9ce6-43a1-a72b-ac20286a5b38', '3842a835-f087-45bf-ad25-79159fb96357'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:16 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:16 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:16 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.520s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Deleted volume successfully. Jul 25 02:43:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d870fe0a-526e-47d7-bba1-8dc70c7fdda7 tempest-VolumesTestJSON-195848994 None] Lock "cinder-f6d7c68b-7d74-4cf8-a234-0bf921a2e9c1-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:20 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (8dc25b38-d340-42e1-8e53-967844ba3bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ce87a7-e5cb-4cfb-bce0-ac4bfe3a50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ce87a7-e5cb-4cfb-bce0-ac4bfe3a50e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904098945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67293a7c-9c59-485b-a26c-4a8790ad7c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:21Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613096ec-5b2f-4ea8-b61c-8f9db8a10d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613096ec-5b2f-4ea8-b61c-8f9db8a10d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbdfb36-44cf-4ad0-a4ee-fb1fa23ae154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbdfb36-44cf-4ad0-a4ee-fb1fa23ae154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67293a7c-9c59-485b-a26c-4a8790ad7c85', 'volume_name': 'volume-67293a7c-9c59-485b-a26c-4a8790ad7c85', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca42489-e41d-4358-9c44-7b8db023d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca42489-e41d-4358-9c44-7b8db023d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b27e3af-8ef8-48e1-a2e2-9de0164283d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Volume 67293a7c-9c59-485b-a26c-4a8790ad7c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67293a7c-9c59-485b-a26c-4a8790ad7c85', 'volume_size': 1} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904098945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67293a7c-9c59-485b-a26c-4a8790ad7c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:21Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Creating volume 67293a7c-9c59-485b-a26c-4a8790ad7c85 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:21 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:21 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 1073741824 Jul 25 02:43:21 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:21 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 1073741824" returned: 0 in 0.744s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:21 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 Jul 25 02:43:21 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:22 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b27e3af-8ef8-48e1-a2e2-9de0164283d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67293a7c-9c59-485b-a26c-4a8790ad7c85', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d695948-cb25-4b19-8cd4-0b92c2b9efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Volume volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 (67293a7c-9c59-485b-a26c-4a8790ad7c85): created successfully Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d695948-cb25-4b19-8cd4-0b92c2b9efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (8dc25b38-d340-42e1-8e53-967844ba3bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f16cbc87-a34f-41ab-a54f-1496b06e53ec tempest-ProjectReaderTests-1391659809 None] Created volume successfully. Jul 25 02:43:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-67293a7c-9c59-485b-a26c-4a8790ad7c85-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-67293a7c-9c59-485b-a26c-4a8790ad7c85-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-quobyte-67293a7c-9c59-485b-a26c-4a8790ad7c85" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-67293a7c-9c59-485b-a26c-4a8790ad7c85" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7fc364-ec7a-4d77-9531-d3515dcdc9af]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:23 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 Jul 25 02:43:23 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:24 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85" returned: 0 in 0.539s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:24 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85 Jul 25 02:43:24 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:24 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-67293a7c-9c59-485b-a26c-4a8790ad7c85" returned: 0 in 0.341s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-67293a7c-9c59-485b-a26c-4a8790ad7c85" released by "delete_volume" :: held 0.948s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Created reservations ['8339ce31-e5a0-4395-9906-dff9006de599', 'c7fa4cff-05d9-44d9-b590-41ca335b2e1f', '4c80f131-cfd9-4c96-939b-b1c006596194', 'd6c08e2e-88e3-49fe-9f95-3090621d230b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:24 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:24 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:25 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.299s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:25 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Deleted volume successfully. Jul 25 02:43:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c5164510-1436-4005-9251-c06d7688c247 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-67293a7c-9c59-485b-a26c-4a8790ad7c85-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (e8b30dd0-dd10-4a29-bcb0-710486fd372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa526f6d-2427-408b-b537-9cb1740c4770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa526f6d-2427-408b-b537-9cb1740c4770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361256531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41a0ec9-e374-40e2-9b23-b063bd70807b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:27Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bdcd5f-fcbd-4066-851c-0f064a3c9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bdcd5f-fcbd-4066-851c-0f064a3c9924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e421c079-d201-44c2-ab02-bc81ee653d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e421c079-d201-44c2-ab02-bc81ee653d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41a0ec9-e374-40e2-9b23-b063bd70807b', 'volume_name': 'volume-f41a0ec9-e374-40e2-9b23-b063bd70807b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc55311-6ca3-473e-8382-ff9f639e7128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc55311-6ca3-473e-8382-ff9f639e7128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d61919-df75-4676-a884-d94ec77a7ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:26 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Volume f41a0ec9-e374-40e2-9b23-b063bd70807b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41a0ec9-e374-40e2-9b23-b063bd70807b', 'volume_size': 1} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361256531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41a0ec9-e374-40e2-9b23-b063bd70807b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:27Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Creating volume f41a0ec9-e374-40e2-9b23-b063bd70807b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:26 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:27 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b 1073741824 Jul 25 02:43:27 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:27 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b 1073741824" returned: 0 in 0.615s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:27 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b Jul 25 02:43:27 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:28 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b" returned: 0 in 0.556s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d61919-df75-4676-a884-d94ec77a7ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41a0ec9-e374-40e2-9b23-b063bd70807b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fda31c4-b402-480a-adea-544901112389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:28 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Volume volume-f41a0ec9-e374-40e2-9b23-b063bd70807b (f41a0ec9-e374-40e2-9b23-b063bd70807b): created successfully Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fda31c4-b402-480a-adea-544901112389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (e8b30dd0-dd10-4a29-bcb0-710486fd372c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:28 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-29b3cd2c-bef3-438c-9a04-0b61a29028c2 tempest-ProjectReaderTests-1391659809 None] Created volume successfully. Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-f41a0ec9-e374-40e2-9b23-b063bd70807b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Lock "cinder-f41a0ec9-e374-40e2-9b23-b063bd70807b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-quobyte-f41a0ec9-e374-40e2-9b23-b063bd70807b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-f41a0ec9-e374-40e2-9b23-b063bd70807b" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f5d16-fd5b-4988-aeef-598e8be81753]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:29 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b Jul 25 02:43:29 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:29 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b" returned: 0 in 0.419s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:29 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b Jul 25 02:43:29 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:29 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f41a0ec9-e374-40e2-9b23-b063bd70807b" returned: 0 in 0.304s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-89a42857-689f-4ba2-81da-41e7a6572dd6 tempest-GroupsV314Test-1738573525 None] Group tempest-GroupsV314Test-Group-1396588220: creating Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-f41a0ec9-e374-40e2-9b23-b063bd70807b" released by "delete_volume" :: held 0.784s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-89a42857-689f-4ba2-81da-41e7a6572dd6 tempest-GroupsV314Test-1738573525 None] Group tempest-GroupsV314Test-Group-1396588220: created successfully Jul 25 02:43:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-89a42857-689f-4ba2-81da-41e7a6572dd6 tempest-GroupsV314Test-1738573525 None] Create group completed successfully. Jul 25 02:43:29 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Created reservations ['d58a1710-8082-4816-9f24-5814c5b72f15', 'c88dc59e-6513-4534-ada5-c7e539834ac9', '32bbe904-01f4-4759-ba9c-9002863e82d3', '267a443f-cc38-4a11-9581-f29fa8908e6b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:30 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:30 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:30 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:30 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Deleted volume successfully. Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e5932cd9-2bc4-4aa7-b038-29952e8bfb9f tempest-ProjectReaderTests-1391659809 None] Lock "cinder-f41a0ec9-e374-40e2-9b23-b063bd70807b-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (217b17fe-3b49-4457-8e74-0c164f6a9ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8836bb5-0bb4-4685-9c6f-794d5e29959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8836bb5-0bb4-4685-9c6f-794d5e29959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910749230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babd9f10-448e-47db-a4cc-3c93d6bd37ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:31Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdff4409-07de-4fc9-aa72-c753311587af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdff4409-07de-4fc9-aa72-c753311587af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2941db26-070e-49f9-8ece-cef94fdbe3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2941db26-070e-49f9-8ece-cef94fdbe3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babd9f10-448e-47db-a4cc-3c93d6bd37ca', 'volume_name': 'volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359ac9c9-1850-4702-8ab4-cbbaf41e6642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359ac9c9-1850-4702-8ab4-cbbaf41e6642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a77fe8a-a9c0-4b44-a68b-c856a1507b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:30 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Volume babd9f10-448e-47db-a4cc-3c93d6bd37ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca', 'volume_size': 1} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910749230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babd9f10-448e-47db-a4cc-3c93d6bd37ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:31Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Creating volume babd9f10-448e-47db-a4cc-3c93d6bd37ca {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:30 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:30 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca 1073741824 Jul 25 02:43:30 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:31 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca 1073741824" returned: 0 in 0.454s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:31 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca Jul 25 02:43:31 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:31 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca" returned: 0 in 0.313s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Flow 'volume_create_manager' (c891a24f-1081-49bd-a2b3-266a75dddd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560fb5bd-93ea-4510-bf32-d011d88b697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a77fe8a-a9c0-4b44-a68b-c856a1507b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c238925-e971-4857-b053-9ee0108cb5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560fb5bd-93ea-4510-bf32-d011d88b697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252709894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fac63fda-0f3c-45da-9006-a371e93af679,host='devstack@QuobyteHD#QuobyteHD',id=f7fa4c53-1c5e-40e0-948f-58372d985d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5511629f78a249bb8d4176d2e7523917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:32Z,use_quota=True,user_id='c7e937ffc29b4aaab7b46a702acdb51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ed4a94-66b6-418a-ad5c-ce5c6de8da9e),volume_type_id=42ed4a94-66b6-418a-ad5c-ce5c6de8da9e)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74f2a28-ce95-4369-a82c-fc495ccff731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74f2a28-ce95-4369-a82c-fc495ccff731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0030f5bc-39d6-4c8f-9bc2-d2a113d4cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0030f5bc-39d6-4c8f-9bc2-d2a113d4cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fa4c53-1c5e-40e0-948f-58372d985d98', 'volume_name': 'volume-f7fa4c53-1c5e-40e0-948f-58372d985d98', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad558a0e-c0e9-4272-b87c-8bb67c06b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad558a0e-c0e9-4272-b87c-8bb67c06b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1bc803-581b-42d1-b6c3-069e14e149f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Volume f7fa4c53-1c5e-40e0-948f-58372d985d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fa4c53-1c5e-40e0-948f-58372d985d98', 'volume_size': 1} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fac63fda-0f3c-45da-9006-a371e93af679,created_at=2026-07-25T00:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252709894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fac63fda-0f3c-45da-9006-a371e93af679,host='devstack@QuobyteHD#QuobyteHD',id=f7fa4c53-1c5e-40e0-948f-58372d985d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5511629f78a249bb8d4176d2e7523917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:32Z,use_quota=True,user_id='c7e937ffc29b4aaab7b46a702acdb51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ed4a94-66b6-418a-ad5c-ce5c6de8da9e),volume_type_id=42ed4a94-66b6-418a-ad5c-ce5c6de8da9e)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Creating volume f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:31 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Volume volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca (babd9f10-448e-47db-a4cc-3c93d6bd37ca): created successfully Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c238925-e971-4857-b053-9ee0108cb5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (217b17fe-3b49-4457-8e74-0c164f6a9ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:31 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 1073741824 Jul 25 02:43:31 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e2c688e2-52fa-4c8a-a6b9-4ba784c65deb tempest-ProjectReaderTests-1391659809 None] Created volume successfully. Jul 25 02:43:32 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 1073741824" returned: 0 in 0.423s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:32 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:32 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:32 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.299s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1bc803-581b-42d1-b6c3-069e14e149f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fa4c53-1c5e-40e0-948f-58372d985d98', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512dc86a-90f0-4a7f-8cdb-f6d96b074d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Volume volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 (f7fa4c53-1c5e-40e0-948f-58372d985d98): created successfully Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512dc86a-90f0-4a7f-8cdb-f6d96b074d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Flow 'volume_create_manager' (c891a24f-1081-49bd-a2b3-266a75dddd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bd549c08-6d93-4a76-a205-ef4b0cb31620 tempest-GroupsV314Test-1738573525 None] Created volume successfully. Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-babd9f10-448e-47db-a4cc-3c93d6bd37ca-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-babd9f10-448e-47db-a4cc-3c93d6bd37ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-quobyte-babd9f10-448e-47db-a4cc-3c93d6bd37ca" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-babd9f10-448e-47db-a4cc-3c93d6bd37ca" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cdefc5-e109-4152-a400-7b6177573379]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:33 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca Jul 25 02:43:33 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:33 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca" returned: 0 in 0.430s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:33 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca Jul 25 02:43:33 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:33 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Cloning volume f7fa4c53-1c5e-40e0-948f-58372d985d98 to volume 6fa73561-92e3-4a46-b884-46d00e4df9dd Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Creating offline snapshot 016e7317-4525-4ef1-98de-d13d94d3cb08 of volume f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445dae5-88cd-4a82-b1d6-4bc1c85fb7d3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:33 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:33 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:33 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-babd9f10-448e-47db-a4cc-3c93d6bd37ca" returned: 0 in 0.333s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-babd9f10-448e-47db-a4cc-3c93d6bd37ca" released by "delete_volume" :: held 0.823s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Created reservations ['c45154ef-087a-467c-bfe8-93f911315e26', '20932a15-4a4f-4865-8abc-a9df4d263cf0', '322e5456-d8d9-414e-8166-42b998fc1a57', 'a5c4dc99-c156-4040-8bf4-ee6b4d5525f5'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:34 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:34 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:34 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.590s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:34 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 1G Jul 25 02:43:34 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:34 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Deleted volume successfully. Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb21d6c1-229d-4f38-8d84-3f06e49e1173 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-babd9f10-448e-47db-a4cc-3c93d6bd37ca-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (50316492-f799-4526-a4a8-a0ace4e7ef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10081e7-29cb-41b4-b5c1-0c178b98505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10081e7-29cb-41b4-b5c1-0c178b98505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804877239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fcb8b6-2c7d-467f-895d-25c672f8c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:35Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffed92f-8fcf-4200-b4c7-3a9ac83db338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffed92f-8fcf-4200-b4c7-3a9ac83db338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69895b31-c5f7-48e6-8e88-c624be86103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69895b31-c5f7-48e6-8e88-c624be86103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fcb8b6-2c7d-467f-895d-25c672f8c465', 'volume_name': 'volume-04fcb8b6-2c7d-467f-895d-25c672f8c465', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd95a295-15f5-4156-be41-4b45f1f4a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd95a295-15f5-4156-be41-4b45f1f4a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e82e78-565f-4c0c-8187-868bbb99c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:34 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Volume 04fcb8b6-2c7d-467f-895d-25c672f8c465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fcb8b6-2c7d-467f-895d-25c672f8c465', 'volume_size': 1} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:34 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 1G" returned: 0 in 0.655s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:34 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 Jul 25 02:43:34 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:35 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:35 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:43:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:35 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 Jul 25 02:43:35 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:35 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08" returned: 0 in 0.256s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:35 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info Jul 25 02:43:35 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:35 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:35 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:43:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:35 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info Jul 25 02:43:35 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:36 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.info" returned: 0 in 0.239s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Acquiring lock "cinder-quobyte-6fa73561-92e3-4a46-b884-46d00e4df9dd" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-6fa73561-92e3-4a46-b884-46d00e4df9dd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] snapshot: 016e7317-4525-4ef1-98de-d13d94d3cb08, volume: 6fa73561-92e3-4a46-b884-46d00e4df9dd, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e749a8de-7c06-444c-bed7-ca4cfa2be2bf]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:36 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 Jul 25 02:43:36 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:36 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08" returned: 0 in 0.337s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7fa4c53-1c5e-40e0-948f-58372d985d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ba3b3-f529-4fb1-8009-8ba0dfa7066b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:36 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:36 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:36 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.355s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:43:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:36 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd Jul 25 02:43:36 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:41 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd" returned: 0 in 4.241s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfabe3f-e256-483d-bcec-142068f5716d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:41 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:41 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:41 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.544s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:43:41 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Converted 1024.00 MB image at 241.36 MB/s Jul 25 02:43:41 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd is being set with open permissions: ugo+rw: NotImplementedError Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:41 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd Jul 25 02:43:41 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:41 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-6fa73561-92e3-4a46-b884-46d00e4df9dd" released by "_copy_volume_from_snapshot" :: held 5.800s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Acquiring lock "cinder-quobyte-016e7317-4525-4ef1-98de-d13d94d3cb08" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-016e7317-4525-4ef1-98de-d13d94d3cb08" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Deleting offline snapshot 016e7317-4525-4ef1-98de-d13d94d3cb08 of volume f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] snapshot_file for this snap is: volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a6c63-e642-420a-8247-140b9c734acb]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:42 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 Jul 25 02:43:42 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:42 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08" returned: 0 in 0.365s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7fa4c53-1c5e-40e0-948f-58372d985d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:43:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ab333-cf64-4621-a2f7-69aa6fbb5aa4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:42 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:42 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:42 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:42 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 Jul 25 02:43:42 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:43 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08" returned: 0 in 0.350s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:43 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08 Jul 25 02:43:43 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:43 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98.016e7317-4525-4ef1-98de-d13d94d3cb08" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-016e7317-4525-4ef1-98de-d13d94d3cb08" released by "_delete_snapshot" :: held 1.436s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.807s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.510s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804877239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fcb8b6-2c7d-467f-895d-25c672f8c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7df14798b14aed977e18c018e1326e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:35Z,use_quota=True,user_id='ff3fc89037b4402db1eebbb0e1344fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Creating volume 04fcb8b6-2c7d-467f-895d-25c672f8c465 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:43 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:43 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 1073741824 Jul 25 02:43:43 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:43 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4bee6e33-b22e-4222-a1a1-a85e90046088 tempest-GroupsV314Test-1738573525 None] Create group from source-group-fac63fda-0f3c-45da-9006-a371e93af679 completed successfully. Jul 25 02:43:43 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 1073741824" returned: 0 in 0.457s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:43 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 Jul 25 02:43:43 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:44 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e82e78-565f-4c0c-8187-868bbb99c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fcb8b6-2c7d-467f-895d-25c672f8c465', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23644bbc-9bc9-472d-aa9d-f5a0cfd6ee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Volume volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 (04fcb8b6-2c7d-467f-895d-25c672f8c465): created successfully Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23644bbc-9bc9-472d-aa9d-f5a0cfd6ee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Flow 'volume_create_manager' (50316492-f799-4526-a4a8-a0ace4e7ef35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-26a28f9d-9f23-40cd-9739-7fb71d3f53cd tempest-ProjectReaderTests-1391659809 None] Created volume successfully. Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Acquiring lock "cinder-quobyte-6fa73561-92e3-4a46-b884-46d00e4df9dd" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-6fa73561-92e3-4a46-b884-46d00e4df9dd" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d82c1a-77ca-48c7-a478-a0bf3c18cd81]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-04fcb8b6-2c7d-467f-895d-25c672f8c465-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-04fcb8b6-2c7d-467f-895d-25c672f8c465-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:44 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd Jul 25 02:43:44 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "cinder-quobyte-04fcb8b6-2c7d-467f-895d-25c672f8c465" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-04fcb8b6-2c7d-467f-895d-25c672f8c465" acquired by "delete_volume" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[20524e0d-aa64-4556-8a29-0f0d53667361]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:45 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 Jul 25 02:43:45 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:45 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd" returned: 0 in 0.619s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:45 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd Jul 25 02:43:45 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:45 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465" returned: 0 in 0.479s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:45 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465 Jul 25 02:43:45 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:45 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6fa73561-92e3-4a46-b884-46d00e4df9dd" returned: 0 in 0.316s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-6fa73561-92e3-4a46-b884-46d00e4df9dd" released by "delete_volume" :: held 0.993s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Created reservations ['988dda8c-d3d0-4be1-83c4-4fcba64b668e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:45 devstack cinder-volume[88279]: WARNING cinder.quota [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1295332646 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1295332646, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:43:45 devstack cinder-volume[88279]: WARNING cinder.quota [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1295332646 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1295332646, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Created reservations ['340914b8-8a3e-4269-9b9d-7c9020fb1a11', '5b480cb6-ef16-4f57-b666-a68488e7b9d8', '6c5610fe-9cfd-4447-97e1-8852cad3d6ec', '77e2bc70-38ba-488b-82bd-1753c2a5507c'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:45 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-04fcb8b6-2c7d-467f-895d-25c672f8c465" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:45 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:45 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-quobyte-04fcb8b6-2c7d-467f-895d-25c672f8c465" released by "delete_volume" :: held 0.941s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Created reservations ['e5a055b7-4ec6-4a28-9d40-63a08681e729', '725e4011-82a8-40f4-ad80-14837e4469b1', 'cf0da2ef-1df3-45d9-98de-1770b5e94087', '09551009-eb25-46de-9811-de8fc4b2a543'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:46 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:46 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:46 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:46 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-647723dd-e51d-4526-b39f-4dcfb66580c7 tempest-GroupsV314Test-1738573525 None] Delete group completed successfully. Jul 25 02:43:46 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:46 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Deleted volume successfully. Jul 25 02:43:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-feb18dda-e14c-4c9a-8bef-a64c2828ff64 tempest-ProjectReaderTests-1391659809 None] Lock "cinder-04fcb8b6-2c7d-467f-895d-25c672f8c465-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Acquiring lock "cinder-quobyte-f7fa4c53-1c5e-40e0-948f-58372d985d98" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-f7fa4c53-1c5e-40e0-948f-58372d985d98" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb89925-7de4-4b34-b9f8-13e17fd649a9]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:47 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:47 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:47 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.377s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:47 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98 Jul 25 02:43:47 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:47 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-f7fa4c53-1c5e-40e0-948f-58372d985d98" returned: 0 in 0.278s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Lock "cinder-quobyte-f7fa4c53-1c5e-40e0-948f-58372d985d98" released by "delete_volume" :: held 0.739s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Created reservations ['3e9db389-847e-4ed7-8ab4-90ef31ed6091'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Created reservations ['9ebe634c-8284-40ef-84ab-146641953351', 'c920f681-e8d3-448d-adcb-f13b07b5bcd0', '5b803add-6336-4df6-9cb4-9501284b97ee', 'c94bcaf7-f570-46fa-98e6-3d458c5e86b3'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:48 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:48 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:48 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:48 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-eb0a802c-564e-4ea8-aa94-4097d27833f3 tempest-GroupsV314Test-1738573525 None] Delete group completed successfully. Jul 25 02:43:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-2d6b91b9-b9e3-4baa-bd5f-23abdb44007b req-14bc2f7b-2ff0-45ba-9d83-781e5d04ad17 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-2d6b91b9-b9e3-4baa-bd5f-23abdb44007b req-14bc2f7b-2ff0-45ba-9d83-781e5d04ad17 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-2d6b91b9-b9e3-4baa-bd5f-23abdb44007b req-14bc2f7b-2ff0-45ba-9d83-781e5d04ad17 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-2d6b91b9-b9e3-4baa-bd5f-23abdb44007b req-14bc2f7b-2ff0-45ba-9d83-781e5d04ad17 tempest-TestInstancesWithCinderVolumes-392406290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-4a726125-1e60-4135-90bf-5a53014f446f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56b748b8-1042-4688-9ee5-616fa2a09913', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:43:49 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-2d6b91b9-b9e3-4baa-bd5f-23abdb44007b req-14bc2f7b-2ff0-45ba-9d83-781e5d04ad17 tempest-TestInstancesWithCinderVolumes-392406290 None] attachment_update completed successfully. Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:50 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:50 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:51 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.283s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:43:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:43:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:43:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=158,cinder:INSERT=49,cinder:UPDATE=195,cinder:DELETE=13 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:43:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-f7881c22-c788-49d0-a52e-30b08b2c9efa req-87822ed7-47b4-4251-9401-7e952d45ccb6 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-f7881c22-c788-49d0-a52e-30b08b2c9efa req-87822ed7-47b4-4251-9401-7e952d45ccb6 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-f7881c22-c788-49d0-a52e-30b08b2c9efa req-87822ed7-47b4-4251-9401-7e952d45ccb6 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-f7881c22-c788-49d0-a52e-30b08b2c9efa req-87822ed7-47b4-4251-9401-7e952d45ccb6 tempest-TestInstancesWithCinderVolumes-392406290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74b4c8f6-430b-4126-9f68-71bbc8f2dab9', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:43:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-f7881c22-c788-49d0-a52e-30b08b2c9efa req-87822ed7-47b4-4251-9401-7e952d45ccb6 tempest-TestInstancesWithCinderVolumes-392406290 None] attachment_update completed successfully. Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Flow 'volume_create_manager' (0b96bb37-2565-41c2-8d9d-b958a476563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e84ac1-7e4b-4e4f-93f2-302bd8726195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e84ac1-7e4b-4e4f-93f2-302bd8726195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-516354460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869582c-2b84-4799-8e75-770f60d83f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1f685e7fcd4c849c6658ba67a32551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:54Z,use_quota=True,user_id='a5f40b355f444d25aac69f50c43ed9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14986168-0a08-49aa-b2a4-a7c0cf76834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14986168-0a08-49aa-b2a4-a7c0cf76834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb5e893-d62e-4a1d-bf1a-5cfa79ac7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb5e893-d62e-4a1d-bf1a-5cfa79ac7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e869582c-2b84-4799-8e75-770f60d83f45', 'volume_name': 'volume-e869582c-2b84-4799-8e75-770f60d83f45', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dec03b-887a-4919-92e9-1dcc9bc5587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dec03b-887a-4919-92e9-1dcc9bc5587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483ce9bc-d745-4d78-9618-ac1cf9bfe6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:53 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Volume e869582c-2b84-4799-8e75-770f60d83f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e869582c-2b84-4799-8e75-770f60d83f45', 'volume_size': 1} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-516354460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869582c-2b84-4799-8e75-770f60d83f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1f685e7fcd4c849c6658ba67a32551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:43:54Z,use_quota=True,user_id='a5f40b355f444d25aac69f50c43ed9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Creating volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:43:53 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:43:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:53 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 1073741824 Jul 25 02:43:53 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:54 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 1073741824" returned: 0 in 0.448s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=141,cinder:INSERT=45,cinder:UPDATE=176,cinder:DELETE=14 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:54 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 Jul 25 02:43:54 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:54 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483ce9bc-d745-4d78-9618-ac1cf9bfe6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e869582c-2b84-4799-8e75-770f60d83f45', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcb1bf3-9f1f-45f0-9436-c9228495b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:43:54 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Volume volume-e869582c-2b84-4799-8e75-770f60d83f45 (e869582c-2b84-4799-8e75-770f60d83f45): created successfully Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcb1bf3-9f1f-45f0-9436-c9228495b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:43:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Flow 'volume_create_manager' (0b96bb37-2565-41c2-8d9d-b958a476563c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:43:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-32ddcefb-f0a9-4616-8155-cf15c8b2081a tempest-SnapshotsActionsTest-1191647721 None] Created volume successfully. Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Creating offline snapshot bea9aac8-0519-4b56-8bff-80d85d00814e of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85e20b5-63fd-4e2e-8d66-2e305b1e2701]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:55 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 Jul 25 02:43:55 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:55 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45" returned: 0 in 0.349s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:55 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e 1G Jul 25 02:43:55 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:55 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e 1G" returned: 0 in 0.407s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:55 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:43:55 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:56 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.295s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:56 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e is being set with open permissions: ugo+rw Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:56 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:43:56 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:56 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:56 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info Jul 25 02:43:56 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:56 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:56 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info is being set with open permissions: ugo+rw Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:56 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info Jul 25 02:43:56 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:56 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.info" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-6b2c5c69-89a7-4914-8e9c-f54ed30e2040 req-6600cab0-d6b0-4f71-8c00-1a71e627fead tempest-TestInstancesWithCinderVolumes-392406290 None] Terminate volume connection completed successfully. Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-6b2c5c69-89a7-4914-8e9c-f54ed30e2040 req-6600cab0-d6b0-4f71-8c00-1a71e627fead tempest-TestInstancesWithCinderVolumes-392406290 None] Deleting attachment 56b748b8-1042-4688-9ee5-616fa2a09913. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:43:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0023e6b2-3ee6-4ef1-aa38-049faddbe989 tempest-SnapshotsActionsTest-1191647721 None] Create snapshot completed successfully Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Creating offline snapshot c152f5ad-6722-458d-a1a4-de16b00214cb of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "cinder-4a726125-1e60-4135-90bf-5a53014f446f-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff4aa5c-459e-4d1c-b307-44f190edb70f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-4a726125-1e60-4135-90bf-5a53014f446f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "cinder-quobyte-4a726125-1e60-4135-90bf-5a53014f446f" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-quobyte-4a726125-1e60-4135-90bf-5a53014f446f" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec24955-09b0-49e4-9cd5-05cf64682117]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:57 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:43:57 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:57 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f Jul 25 02:43:57 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:58 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.412s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:58 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb 1G Jul 25 02:43:58 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:58 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f" returned: 0 in 0.398s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:58 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f Jul 25 02:43:58 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:58 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4a726125-1e60-4135-90bf-5a53014f446f" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-quobyte-4a726125-1e60-4135-90bf-5a53014f446f" released by "delete_volume" :: held 0.738s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:58 devstack cinder-volume[88279]: WARNING cinder.quota [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1513868118-1934649189 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1513868118-1934649189, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:43:58 devstack cinder-volume[88279]: WARNING cinder.quota [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1513868118-1934649189 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1513868118-1934649189, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Created reservations ['59b32b9c-1c41-4d87-bca0-a02709f31c8b', '10ff876e-dfee-485e-b388-b97d152646d5', '18a4064a-a3c6-4747-b9e0-742cf993b4a7', '1b5fca74-c7da-4101-bf65-249463069dba'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:43:58 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb 1G" returned: 0 in 0.516s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:58 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb Jul 25 02:43:58 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:58 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:43:58 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:58 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:43:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Deleted volume successfully. Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4eefd40a-7a7c-4612-bd3b-debd356ed550 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-4a726125-1e60-4135-90bf-5a53014f446f-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:43:58 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb" returned: 0 in 0.349s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:58 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb is being set with open permissions: ugo+rw Jul 25 02:43:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:58 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb Jul 25 02:43:58 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:43:59 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.627s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:43:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6fc50479-6287-4c51-935e-dadbd4940219 tempest-SnapshotsActionsTest-1191647721 None] Create snapshot completed successfully Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-c152f5ad-6722-458d-a1a4-de16b00214cb-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-c152f5ad-6722-458d-a1a4-de16b00214cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-c152f5ad-6722-458d-a1a4-de16b00214cb" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-c152f5ad-6722-458d-a1a4-de16b00214cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Deleting offline snapshot c152f5ad-6722-458d-a1a4-de16b00214cb of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] snapshot_file for this snap is: volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23bab01-1a87-4c4a-a76a-74ce07c74ef7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:43:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:43:59 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb Jul 25 02:43:59 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:00 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb" returned: 0 in 0.364s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac8bf49-1806-4ac3-b305-caac91ae45f7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:00 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:00 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:00 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:00 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb Jul 25 02:44:00 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:01 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb" returned: 0 in 0.367s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:01 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb Jul 25 02:44:01 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:01 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.c152f5ad-6722-458d-a1a4-de16b00214cb" returned: 0 in 0.256s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-c152f5ad-6722-458d-a1a4-de16b00214cb" released by "_delete_snapshot" :: held 1.465s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" released by "delete_snapshot" :: held 1.490s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-11f1105f-654a-433e-b012-86afd0c55d71 req-85938901-8c84-4935-9921-1bd7359e8f20 tempest-TestInstancesWithCinderVolumes-392406290 None] Terminate volume connection completed successfully. Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-11f1105f-654a-433e-b012-86afd0c55d71 req-85938901-8c84-4935-9921-1bd7359e8f20 tempest-TestInstancesWithCinderVolumes-392406290 None] Deleting attachment 74b4c8f6-430b-4126-9f68-71bbc8f2dab9. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Created reservations ['aa320fc3-a69e-412c-8476-658951b458c6', 'a2903246-05f0-4790-9cf4-667496f769a1', 'aee236a9-7385-42d4-90f7-e85dbf1cd42f', '1fd59e43-4607-451c-ae21-3a4738f30ac6'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Delete snapshot completed successfully. Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a042e53f-963f-4f92-8bcd-eb613683f956 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-c152f5ad-6722-458d-a1a4-de16b00214cb-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "cinder-0996ddab-3ab6-4bc5-a233-37ceac2acb1e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-0996ddab-3ab6-4bc5-a233-37ceac2acb1e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "cinder-quobyte-0996ddab-3ab6-4bc5-a233-37ceac2acb1e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-quobyte-0996ddab-3ab6-4bc5-a233-37ceac2acb1e" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc366a30-7464-4976-8c25-d66c2fed038f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:02 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e Jul 25 02:44:02 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Creating offline snapshot d20ae93d-9634-4cc5-a448-d53fb84c19c0 of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c477494-a32b-44df-8860-f4e18c8f744f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:02 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:02 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e Jul 25 02:44:02 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:02 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:02 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:02 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0996ddab-3ab6-4bc5-a233-37ceac2acb1e" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-quobyte-0996ddab-3ab6-4bc5-a233-37ceac2acb1e" released by "delete_volume" :: held 0.719s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:02 devstack cinder-volume[88279]: WARNING cinder.quota [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2062514600-902348795 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2062514600-902348795, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:44:02 devstack cinder-volume[88279]: WARNING cinder.quota [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2062514600-902348795 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2062514600-902348795, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Created reservations ['4becf19e-deb0-4735-be2c-b6dc44b05e46', '580bed4d-038a-49aa-914f-77619a3971f9', '6f9bfea4-c5fe-4645-8656-ee13124b715c', '14891b76-6503-4279-8ce6-27e0fda344ab'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:02 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.406s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:02 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 1G Jul 25 02:44:02 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:02 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:44:02 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:03 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.313s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:44:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Deleted volume successfully. Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-82d9516b-208a-4467-8434-9b8dc74c5366 tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-0996ddab-3ab6-4bc5-a233-37ceac2acb1e-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:03 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 1G" returned: 0 in 0.478s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:03 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 Jul 25 02:44:03 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:03 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0" returned: 0 in 0.350s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:03 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 is being set with open permissions: ugo+rw Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:03 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 Jul 25 02:44:03 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:03 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0" returned: 0 in 0.250s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.606s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-74b151ff-a89e-4a71-bf26-0e86ba70af9b tempest-SnapshotsActionsTest-1191647721 None] Create snapshot completed successfully Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-d20ae93d-9634-4cc5-a448-d53fb84c19c0-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-d20ae93d-9634-4cc5-a448-d53fb84c19c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-d20ae93d-9634-4cc5-a448-d53fb84c19c0" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-d20ae93d-9634-4cc5-a448-d53fb84c19c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Deleting offline snapshot d20ae93d-9634-4cc5-a448-d53fb84c19c0 of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] snapshot_file for this snap is: volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1856557a-7963-44f0-b5ec-985a650ddc86]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:04 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 Jul 25 02:44:04 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:05 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0" returned: 0 in 0.554s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3bd9e6-6ab0-4fbe-8db6-9b477b012ce6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:05 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:05 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:05 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.438s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:05 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 Jul 25 02:44:05 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:06 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0" returned: 0 in 0.457s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:06 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0 Jul 25 02:44:06 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-0cc28ccf-fb9b-45c5-99b9-ecbd0b49deee req-09b7ce6e-7f09-4aa6-b576-0ae8d7d12d9d tempest-TestInstancesWithCinderVolumes-392406290 None] Terminate volume connection completed successfully. Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-0cc28ccf-fb9b-45c5-99b9-ecbd0b49deee req-09b7ce6e-7f09-4aa6-b576-0ae8d7d12d9d tempest-TestInstancesWithCinderVolumes-392406290 None] Deleting attachment 60852538-9b10-45da-abe0-460bd6fa79c6. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:44:06 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.d20ae93d-9634-4cc5-a448-d53fb84c19c0" returned: 0 in 0.279s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-d20ae93d-9634-4cc5-a448-d53fb84c19c0" released by "_delete_snapshot" :: held 1.864s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" released by "delete_snapshot" :: held 1.891s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Created reservations ['da0c07f8-7577-4c8b-9e5f-2b4c30e76661', 'cc353335-6e47-4314-9767-a72f2ac0c60a', '855d3c6b-9bc8-402c-badf-4e86b54d87fa', '0cb28114-ea47-4ae7-9b96-b3503148c1de'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Delete snapshot completed successfully. Jul 25 02:44:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4229d5af-fa2b-4111-90e2-8c48e89dfeaa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-d20ae93d-9634-4cc5-a448-d53fb84c19c0-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Creating offline snapshot 0425c78a-aec4-450c-a99a-f9bade45bde9 of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72d7d0f-6033-4632-9784-32273639ee21]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:07 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:07 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "cinder-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "cinder-quobyte-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-quobyte-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d386de6-db93-4b6e-aff0-9d238dbc5008]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:07 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc Jul 25 02:44:07 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:07 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:07 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 1G Jul 25 02:44:07 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:07 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" returned: 0 in 0.386s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:07 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc Jul 25 02:44:07 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:07 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 1G" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:07 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 Jul 25 02:44:07 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:07 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" returned: 0 in 0.245s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-quobyte-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc" released by "delete_volume" :: held 0.676s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:07 devstack cinder-volume[88279]: WARNING cinder.quota [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-377369720-484654141 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-377369720-484654141, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:44:07 devstack cinder-volume[88279]: WARNING cinder.quota [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-377369720-484654141 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-377369720-484654141, it is now deprecated. Please use the default quota class for default quota. Jul 25 02:44:07 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Created reservations ['a1f19338-be5b-4d7a-a934-442cb80d90b7', '56812396-b28b-44fa-9b32-34369d3f568f', '422fbe17-d87e-40f9-a665-caff4c1cf079', '81b46315-12e3-4061-9520-08795a272117'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:08 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:44:08 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:08 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9" returned: 0 in 0.306s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:08 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 is being set with open permissions: ugo+rw Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:08 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 Jul 25 02:44:08 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:08 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.250s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:44:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Deleted volume successfully. Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2c5f60dc-6ff9-4317-afd2-aff4e4f8567e tempest-TestInstancesWithCinderVolumes-392406290 None] Lock "cinder-063b7148-b6d1-41ee-b00b-0dff5ae7fdbc-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:08 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9" returned: 0 in 0.260s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.457s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0104966a-ade0-488c-a33d-71f95fdf760a tempest-SnapshotsActionsTest-1191647721 None] Create snapshot completed successfully Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-0425c78a-aec4-450c-a99a-f9bade45bde9-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-0425c78a-aec4-450c-a99a-f9bade45bde9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-0425c78a-aec4-450c-a99a-f9bade45bde9" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-0425c78a-aec4-450c-a99a-f9bade45bde9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Deleting offline snapshot 0425c78a-aec4-450c-a99a-f9bade45bde9 of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] snapshot_file for this snap is: volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[820d1911-e4b1-4ac6-86f1-a07dbe1b9425]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:09 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 Jul 25 02:44:09 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:09 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9" returned: 0 in 0.397s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a490c4f8-a9c6-44f1-a1c1-03a72342edb8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:09 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:09 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:10 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.367s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:10 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 Jul 25 02:44:10 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:10 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:10 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9 Jul 25 02:44:10 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:10 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.0425c78a-aec4-450c-a99a-f9bade45bde9" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-0425c78a-aec4-450c-a99a-f9bade45bde9" released by "_delete_snapshot" :: held 1.537s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" released by "delete_snapshot" :: held 1.561s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Created reservations ['c5654622-13ac-4e9e-84d2-2375082d0df5', 'dba8d6c1-244b-4b7c-9706-d6fc629c3182', 'a035251e-4011-466f-8ad0-a5690ed991ae', '7d1b020a-e2bd-4636-8979-b345fa2398ba'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Delete snapshot completed successfully. Jul 25 02:44:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e1cc47ca-4df1-4907-a56e-84b5ca597ff5 tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-0425c78a-aec4-450c-a99a-f9bade45bde9-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Creating offline snapshot 8f762c68-4a8b-4abe-b2da-0d718943b19d of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:44:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a6675-09de-45f7-843f-0a844d9ba40a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:11 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:11 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:12 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.420s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:12 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d 1G Jul 25 02:44:12 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:12 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d 1G" returned: 0 in 0.474s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:12 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d Jul 25 02:44:12 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:12 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:12 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d is being set with open permissions: ugo+rw Jul 25 02:44:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:12 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d Jul 25 02:44:12 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:13 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.572s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-baf330ec-8b50-4cd4-8087-fb79ed312aa2 tempest-SnapshotsActionsTest-1191647721 None] Create snapshot completed successfully Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-8f762c68-4a8b-4abe-b2da-0d718943b19d-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-8f762c68-4a8b-4abe-b2da-0d718943b19d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Acquiring lock "cinder-quobyte-8f762c68-4a8b-4abe-b2da-0d718943b19d" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-8f762c68-4a8b-4abe-b2da-0d718943b19d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Deleting offline snapshot 8f762c68-4a8b-4abe-b2da-0d718943b19d of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:44:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] snapshot_file for this snap is: volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e85145-af62-4c48-8089-94bd95fb4855]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:14 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d Jul 25 02:44:14 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:14 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d02ee0-0f0e-4e52-85ed-3ff09a6799af]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:14 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:14 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:14 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.399s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:14 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d Jul 25 02:44:14 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:15 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d" returned: 0 in 0.412s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:15 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d Jul 25 02:44:15 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:15 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.8f762c68-4a8b-4abe-b2da-0d718943b19d" returned: 0 in 0.322s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-8f762c68-4a8b-4abe-b2da-0d718943b19d" released by "_delete_snapshot" :: held 1.626s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" released by "delete_snapshot" :: held 1.649s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Created reservations ['4c330d66-27d3-43b9-90a6-5f8898a58a48', 'c7db3fa3-8fc0-4cce-b402-38d3f72c490e', '2bddf94d-1174-4c5c-a767-237fe94ce695', 'b31ae62a-6e45-4d57-8112-494cc1bdf893'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:15 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Delete snapshot completed successfully. Jul 25 02:44:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-79e7ddfb-659b-4598-b642-9961138427fa tempest-SnapshotsActionsTest-1567106640 None] Lock "cinder-8f762c68-4a8b-4abe-b2da-0d718943b19d-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "cinder-bea9aac8-0519-4b56-8bff-80d85d00814e-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-bea9aac8-0519-4b56-8bff-80d85d00814e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "cinder-quobyte-bea9aac8-0519-4b56-8bff-80d85d00814e" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-quobyte-bea9aac8-0519-4b56-8bff-80d85d00814e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Deleting offline snapshot bea9aac8-0519-4b56-8bff-80d85d00814e of volume e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] snapshot_file for this snap is: volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[24104d33-f716-4570-bf18-47a41ae0fa8a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:16 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:16 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:17 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.393s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e869582c-2b84-4799-8e75-770f60d83f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a32b3c3-cd45-46d2-a8bd-6b5bf3c67a04]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:17 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 Jul 25 02:44:17 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:17 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45" returned: 0 in 0.383s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:17 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:17 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:17 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.364s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:17 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e Jul 25 02:44:17 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:18 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45.bea9aac8-0519-4b56-8bff-80d85d00814e" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-quobyte-bea9aac8-0519-4b56-8bff-80d85d00814e" released by "_delete_snapshot" :: held 1.509s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" released by "delete_snapshot" :: held 1.550s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Created reservations ['0b6f8b74-4554-44d4-9d72-5d13ee0ff0b4', '7f00a98b-28af-461a-8069-b0265dcf6d81', 'cd5de2d5-a86d-45e7-8708-f78666f6cc9b', 'c3b2b2c6-5187-4d88-aac4-16c0613f0f40'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Delete snapshot completed successfully. Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c73a2f0b-29c8-44a6-a840-d681b0a79a8e tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-bea9aac8-0519-4b56-8bff-80d85d00814e-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "cinder-e869582c-2b84-4799-8e75-770f60d83f45-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-e869582c-2b84-4799-8e75-770f60d83f45-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce5d1c-a231-49b9-bbc4-31ed14a721d4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:18 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 Jul 25 02:44:18 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:19 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:19 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45 Jul 25 02:44:19 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:19 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e869582c-2b84-4799-8e75-770f60d83f45" returned: 0 in 0.256s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-quobyte-e869582c-2b84-4799-8e75-770f60d83f45" released by "delete_volume" :: held 0.681s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Created reservations ['8c3be2e5-8cf2-4146-a12a-5bf45b5ec684', '0c7df10e-c0c1-4d79-a53a-9b2360424320', '43462400-da1e-4cdc-b519-7e7196f90685', '437876d2-fb27-4030-ac37-5c2ba8255287'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:19 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:44:19 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:19 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.295s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:44:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Deleted volume successfully. Jul 25 02:44:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b90bf325-144b-4a9e-9963-5c028c872cc6 tempest-SnapshotsActionsTest-1191647721 None] Lock "cinder-e869582c-2b84-4799-8e75-770f60d83f45-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:30 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=63,cinder:DELETE=5,cinder:SELECT=53,cinder:INSERT=19 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:44:30 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=74,cinder:UPDATE=74,cinder:INSERT=19,cinder:DELETE=5 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Flow 'volume_create_manager' (afb2a45d-540e-4356-a778-c76211ab1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac622d81-c1c3-4169-a8e8-8032f7caa5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac622d81-c1c3-4169-a8e8-8032f7caa5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1560234320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b162f707-3512-48d1-ae48-bdcc761f9a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d88ebe331e2473180acf94908c0fa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:44:32Z,use_quota=True,user_id='fef19032483b4945b88d1dd455d5a71a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9606318-196c-4462-ac96-7e73b68e1c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9606318-196c-4462-ac96-7e73b68e1c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88477f0f-3056-4812-8b84-3ada01869dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88477f0f-3056-4812-8b84-3ada01869dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b162f707-3512-48d1-ae48-bdcc761f9a5c', 'volume_name': 'volume-b162f707-3512-48d1-ae48-bdcc761f9a5c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34250fe9-5f66-46a5-8573-0b86381c5494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34250fe9-5f66-46a5-8573-0b86381c5494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a90f25-cce7-4dd8-8cc2-e8659c64fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Volume b162f707-3512-48d1-ae48-bdcc761f9a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b162f707-3512-48d1-ae48-bdcc761f9a5c', 'volume_size': 1} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1560234320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b162f707-3512-48d1-ae48-bdcc761f9a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d88ebe331e2473180acf94908c0fa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:44:32Z,use_quota=True,user_id='fef19032483b4945b88d1dd455d5a71a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Creating volume b162f707-3512-48d1-ae48-bdcc761f9a5c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:44:32 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:32 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c 1073741824 Jul 25 02:44:32 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:32 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c 1073741824" returned: 0 in 0.459s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:32 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c Jul 25 02:44:32 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:32 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c" returned: 0 in 0.257s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a90f25-cce7-4dd8-8cc2-e8659c64fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b162f707-3512-48d1-ae48-bdcc761f9a5c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ca171e-36c8-447c-828b-d863c1b8c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Volume volume-b162f707-3512-48d1-ae48-bdcc761f9a5c (b162f707-3512-48d1-ae48-bdcc761f9a5c): created successfully Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ca171e-36c8-447c-828b-d863c1b8c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Flow 'volume_create_manager' (afb2a45d-540e-4356-a778-c76211ab1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:44:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-efafc08a-45b0-4f85-8f47-d8de8086aa88 tempest-VolumeQuotasNegativeTestJSON-175260791 None] Created volume successfully. Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Acquiring lock "cinder-b162f707-3512-48d1-ae48-bdcc761f9a5c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "cinder-b162f707-3512-48d1-ae48-bdcc761f9a5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Acquiring lock "cinder-quobyte-b162f707-3512-48d1-ae48-bdcc761f9a5c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "cinder-quobyte-b162f707-3512-48d1-ae48-bdcc761f9a5c" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1abf5af-f246-4503-8030-79ef9d13d903]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:35 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c Jul 25 02:44:35 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:35 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c" returned: 0 in 0.401s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:35 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c Jul 25 02:44:35 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:36 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b162f707-3512-48d1-ae48-bdcc761f9a5c" returned: 0 in 0.282s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "cinder-quobyte-b162f707-3512-48d1-ae48-bdcc761f9a5c" released by "delete_volume" :: held 0.752s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Created reservations ['65e1044f-d565-425c-9e2d-88e807d1a2e3', '932505f2-ce53-4850-9d0d-d4ebcb40e537', '6b1e3530-c21a-43ac-b02e-424525a2a623', '1f8119ee-91c0-402d-940e-7ef5c1f4bcfc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:36 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:44:36 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:36 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.333s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:44:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Deleted volume successfully. Jul 25 02:44:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d24c1d55-ee71-46f6-8686-9b35318dd71a tempest-VolumeQuotasNegativeTestJSON-175260791 None] Lock "cinder-b162f707-3512-48d1-ae48-bdcc761f9a5c-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:44:46 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=15,cinder:SELECT=7,cinder:INSERT=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:44:46 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:50 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:44:50 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:51 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.370s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:44:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:44:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:44:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Flow 'volume_create_manager' (e590264b-0f9e-401c-b081-379ccdc4a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c370baa-d3d0-4344-a497-a52266ca5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c370baa-d3d0-4344-a497-a52266ca5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1512311214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37caaf85-0190-44ff-a332-18f07dee74d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae511bcc48b4fdf952bd057782f471b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:44:54Z,use_quota=True,user_id='20c0603d039a4ecc842bd75f91e52bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48c78f0-8cbb-4b90-826e-08365113a74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48c78f0-8cbb-4b90-826e-08365113a74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638f6009-dd21-4a48-8bb2-be7887dc617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638f6009-dd21-4a48-8bb2-be7887dc617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37caaf85-0190-44ff-a332-18f07dee74d0', 'volume_name': 'volume-37caaf85-0190-44ff-a332-18f07dee74d0', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1beafe59-5b8a-40b9-b683-ed9ccee504ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1beafe59-5b8a-40b9-b683-ed9ccee504ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a452005-c2c5-4c8d-90bf-203c2768194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:54 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Volume 37caaf85-0190-44ff-a332-18f07dee74d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37caaf85-0190-44ff-a332-18f07dee74d0', 'volume_size': 1} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1512311214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37caaf85-0190-44ff-a332-18f07dee74d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae511bcc48b4fdf952bd057782f471b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:44:54Z,use_quota=True,user_id='20c0603d039a4ecc842bd75f91e52bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Creating volume 37caaf85-0190-44ff-a332-18f07dee74d0 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:44:54 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:54 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 1073741824 Jul 25 02:44:54 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:54 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 1073741824" returned: 0 in 0.495s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:44:54 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 Jul 25 02:44:54 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:44:55 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a452005-c2c5-4c8d-90bf-203c2768194c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37caaf85-0190-44ff-a332-18f07dee74d0', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690cb5a2-ade1-4664-891d-6f2a84b5dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:44:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Volume volume-37caaf85-0190-44ff-a332-18f07dee74d0 (37caaf85-0190-44ff-a332-18f07dee74d0): created successfully Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690cb5a2-ade1-4664-891d-6f2a84b5dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:44:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Flow 'volume_create_manager' (e590264b-0f9e-401c-b081-379ccdc4a46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:44:55 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-742a4c51-ecf9-4338-aeaf-d852b5d4c71a tempest-TestMinimumBasicScenario-421814732 None] Created volume successfully. Jul 25 02:44:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-8a4549c1-868a-4604-8362-9931a5300859 req-c7b76e2d-247f-43f5-99cb-67ac1c32b305 tempest-TestMinimumBasicScenario-421814732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:44:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-8a4549c1-868a-4604-8362-9931a5300859 req-c7b76e2d-247f-43f5-99cb-67ac1c32b305 tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:44:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-8a4549c1-868a-4604-8362-9931a5300859 req-c7b76e2d-247f-43f5-99cb-67ac1c32b305 tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:44:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-8a4549c1-868a-4604-8362-9931a5300859 req-c7b76e2d-247f-43f5-99cb-67ac1c32b305 tempest-TestMinimumBasicScenario-421814732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-37caaf85-0190-44ff-a332-18f07dee74d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c39391b-539b-4304-8b3c-e6fd9818a17e', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:44:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-8a4549c1-868a-4604-8362-9931a5300859 req-c7b76e2d-247f-43f5-99cb-67ac1c32b305 tempest-TestMinimumBasicScenario-421814732 None] attachment_update completed successfully. Jul 25 02:45:07 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:45:07 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (7d19eaf9-c244-4867-9776-cb9cea88efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be51e1ac-eb27-4762-8146-624c4a61d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be51e1ac-eb27-4762-8146-624c4a61d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73991086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08000527-465f-4c2e-b868-a4e385ff07f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:11Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af51412-e066-4d0e-ab14-53d848c7cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af51412-e066-4d0e-ab14-53d848c7cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66173e64-4643-431c-87af-c5a18100e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66173e64-4643-431c-87af-c5a18100e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08000527-465f-4c2e-b868-a4e385ff07f3', 'volume_name': 'volume-08000527-465f-4c2e-b868-a4e385ff07f3', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffc4031-1721-4919-bdfa-3a2ac5d443a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffc4031-1721-4919-bdfa-3a2ac5d443a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a658bf-0fde-43dc-a3da-aa4ec15f9938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:11 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Volume 08000527-465f-4c2e-b868-a4e385ff07f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08000527-465f-4c2e-b868-a4e385ff07f3', 'volume_size': 1} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73991086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08000527-465f-4c2e-b868-a4e385ff07f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:11Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Creating volume 08000527-465f-4c2e-b868-a4e385ff07f3 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:11 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:11 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 1073741824 Jul 25 02:45:11 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:11 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 1073741824" returned: 0 in 0.474s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:11 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 Jul 25 02:45:11 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:11 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3" returned: 0 in 0.303s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a658bf-0fde-43dc-a3da-aa4ec15f9938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08000527-465f-4c2e-b868-a4e385ff07f3', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b15380-aa66-4e61-bb90-276cc4468c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:12 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Volume volume-08000527-465f-4c2e-b868-a4e385ff07f3 (08000527-465f-4c2e-b868-a4e385ff07f3): created successfully Jul 25 02:45:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b15380-aa66-4e61-bb90-276cc4468c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (7d19eaf9-c244-4867-9776-cb9cea88efa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-94f4b76a-81cb-4186-bbdf-d714fd824208 tempest-VolumesActionsTest-1725263707 None] Created volume successfully. Jul 25 02:45:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2132705c-6d87-4cb1-bec4-ea2022a411b9 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3" by "attach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2132705c-6d87-4cb1-bec4-ea2022a411b9 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3" acquired by "attach_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2132705c-6d87-4cb1-bec4-ea2022a411b9 tempest-VolumesActionsTest-1725263707 None] Attaching volume 08000527-465f-4c2e-b868-a4e385ff07f3 to instance 819e7823-4ee0-4292-aa8e-4cfac5e7f9a2 at mountpoint /dev/vdb on host None. Jul 25 02:45:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2132705c-6d87-4cb1-bec4-ea2022a411b9 tempest-VolumesActionsTest-1725263707 None] Attach volume completed successfully. Jul 25 02:45:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2132705c-6d87-4cb1-bec4-ea2022a411b9 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3" released by "attach_volume" :: held 0.099s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9674bc95-c85e-4fb7-b2d7-d041e81986c2 tempest-VolumesActionsTest-1799382257 None] Terminate volume connection completed successfully. Jul 25 02:45:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9674bc95-c85e-4fb7-b2d7-d041e81986c2 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-detach_volume" by "detach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9674bc95-c85e-4fb7-b2d7-d041e81986c2 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9674bc95-c85e-4fb7-b2d7-d041e81986c2 tempest-VolumesActionsTest-1799382257 None] Detaching volume 08000527-465f-4c2e-b868-a4e385ff07f3 from instance 819e7823-4ee0-4292-aa8e-4cfac5e7f9a2. Jul 25 02:45:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9674bc95-c85e-4fb7-b2d7-d041e81986c2 tempest-VolumesActionsTest-1799382257 None] Detach volume completed successfully. Jul 25 02:45:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9674bc95-c85e-4fb7-b2d7-d041e81986c2 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef804fb5-fa4e-4d31-a53f-6cdc891ecbc7 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-detach_volume" by "detach_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef804fb5-fa4e-4d31-a53f-6cdc891ecbc7 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ef804fb5-fa4e-4d31-a53f-6cdc891ecbc7 tempest-VolumesActionsTest-1725263707 None] Volume detach called, but volume not attached. Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef804fb5-fa4e-4d31-a53f-6cdc891ecbc7 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "cinder-quobyte-08000527-465f-4c2e-b868-a4e385ff07f3" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-quobyte-08000527-465f-4c2e-b868-a4e385ff07f3" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af1690b-724d-4422-805e-8cb91c754fa1]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:14 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 Jul 25 02:45:14 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:14 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3" returned: 0 in 0.361s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:14 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3 Jul 25 02:45:14 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:15 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-08000527-465f-4c2e-b868-a4e385ff07f3" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-quobyte-08000527-465f-4c2e-b868-a4e385ff07f3" released by "delete_volume" :: held 0.650s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Created reservations ['73574203-5c8d-4365-85e5-35422b4c1173', 'd12f2d13-57ce-4522-858d-fbe4ee6d19c6', '79688779-f40d-4221-bc5e-a785d1e63293', '1fe4cd4e-df50-431b-a256-2346dea4685e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:15 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:15 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:15 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:15 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Deleted volume successfully. Jul 25 02:45:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-584e0c8c-6729-4701-9c14-de0fc495fe77 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-08000527-465f-4c2e-b868-a4e385ff07f3-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (8f5acb64-cd02-4dfe-8013-7375f0a86d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb24b71-5497-4ed6-bd01-58c732fecb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb24b71-5497-4ed6-bd01-58c732fecb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1680337960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ae2629-b8ca-458d-a31f-f7f21cba6716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:19Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b65af3-66d8-4f29-8ba6-60827743e09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b65af3-66d8-4f29-8ba6-60827743e09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f11726e-c7c1-4dd0-83bf-cc0b5ae7c3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f11726e-c7c1-4dd0-83bf-cc0b5ae7c3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ae2629-b8ca-458d-a31f-f7f21cba6716', 'volume_name': 'volume-76ae2629-b8ca-458d-a31f-f7f21cba6716', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f341ed-e948-43ba-99ca-7da09e74f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f341ed-e948-43ba-99ca-7da09e74f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce24bfb-d05c-4a37-a19f-b5cc930c9fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:18 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Volume 76ae2629-b8ca-458d-a31f-f7f21cba6716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ae2629-b8ca-458d-a31f-f7f21cba6716', 'volume_size': 1} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1680337960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ae2629-b8ca-458d-a31f-f7f21cba6716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:19Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Creating volume 76ae2629-b8ca-458d-a31f-f7f21cba6716 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:19 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:19 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 1073741824 Jul 25 02:45:19 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:19 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 1073741824" returned: 0 in 0.435s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:19 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 Jul 25 02:45:19 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:19 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716" returned: 0 in 0.260s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce24bfb-d05c-4a37-a19f-b5cc930c9fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ae2629-b8ca-458d-a31f-f7f21cba6716', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53a30aa-7e22-4be4-86dc-b57c37eda731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Volume volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 (76ae2629-b8ca-458d-a31f-f7f21cba6716): created successfully Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53a30aa-7e22-4be4-86dc-b57c37eda731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (8f5acb64-cd02-4dfe-8013-7375f0a86d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ecc78308-aa8d-4c0c-8881-c7abdea7de97 tempest-VolumesActionsTest-1725263707 None] Created volume successfully. Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-76ae2629-b8ca-458d-a31f-f7f21cba6716-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-76ae2629-b8ca-458d-a31f-f7f21cba6716-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-quobyte-76ae2629-b8ca-458d-a31f-f7f21cba6716" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-76ae2629-b8ca-458d-a31f-f7f21cba6716" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecffebf3-5150-4757-8f76-e6481b1a3359]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:21 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 Jul 25 02:45:21 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:21 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:21 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716 Jul 25 02:45:21 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:21 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-76ae2629-b8ca-458d-a31f-f7f21cba6716" returned: 0 in 0.233s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-76ae2629-b8ca-458d-a31f-f7f21cba6716" released by "delete_volume" :: held 0.621s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Created reservations ['bf728670-a912-4776-881f-c73412a0046a', 'c16dc6c5-a733-419b-84d3-feb365b56cae', 'e4784ca1-9979-46f1-ade4-722c34d84355', '18791c58-4875-4477-8857-861064cfd0b2'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:21 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:21 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:22 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.234s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Deleted volume successfully. Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e856842-cf8e-48ec-bc47-8a541e45de48 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-76ae2629-b8ca-458d-a31f-f7f21cba6716-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (711e27dd-ab90-4ffa-941c-f44520c34843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb6ebdb-7e92-485a-9b8b-3292dd154898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb6ebdb-7e92-485a-9b8b-3292dd154898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-769855903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35683758-d706-40a8-9326-54a10c5eb06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:23Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a259dbe6-1069-4106-b053-2deee4bc8808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a259dbe6-1069-4106-b053-2deee4bc8808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7876c770-e193-4df8-a064-6a8c8c65a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7876c770-e193-4df8-a064-6a8c8c65a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35683758-d706-40a8-9326-54a10c5eb06f', 'volume_name': 'volume-35683758-d706-40a8-9326-54a10c5eb06f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a175d0-c557-4855-93cf-853898272dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a175d0-c557-4855-93cf-853898272dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5427b630-9561-466d-9ebc-d330c458dd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Volume 35683758-d706-40a8-9326-54a10c5eb06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35683758-d706-40a8-9326-54a10c5eb06f', 'volume_size': 1} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-769855903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35683758-d706-40a8-9326-54a10c5eb06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:23Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Creating volume 35683758-d706-40a8-9326-54a10c5eb06f {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:22 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:22 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f 1073741824 Jul 25 02:45:22 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:23 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f 1073741824" returned: 0 in 0.406s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:23 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f Jul 25 02:45:23 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:23 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f" returned: 0 in 0.276s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5427b630-9561-466d-9ebc-d330c458dd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35683758-d706-40a8-9326-54a10c5eb06f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487cde7b-e281-411d-8ca2-8f2d40adfb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:23 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Volume volume-35683758-d706-40a8-9326-54a10c5eb06f (35683758-d706-40a8-9326-54a10c5eb06f): created successfully Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487cde7b-e281-411d-8ca2-8f2d40adfb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (711e27dd-ab90-4ffa-941c-f44520c34843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a0f08ace-2634-4e83-a5f4-534de94e03a6 tempest-VolumesActionsTest-1725263707 None] Created volume successfully. Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-35683758-d706-40a8-9326-54a10c5eb06f-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-35683758-d706-40a8-9326-54a10c5eb06f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-quobyte-35683758-d706-40a8-9326-54a10c5eb06f" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-35683758-d706-40a8-9326-54a10c5eb06f" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb25bc0e-06d1-44ae-9e6a-7d7327da5678]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:24 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f Jul 25 02:45:24 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:24 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f" returned: 0 in 0.363s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:24 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f Jul 25 02:45:24 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:24 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-35683758-d706-40a8-9326-54a10c5eb06f" returned: 0 in 0.250s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-35683758-d706-40a8-9326-54a10c5eb06f" released by "delete_volume" :: held 0.657s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Created reservations ['36fa0b2f-818c-4f6b-bcd2-f413794ef8da', '0d303104-3953-487e-9439-0ce6b0f71118', 'b6da568c-bfdf-47b4-9a29-92dcff1b00ac', 'c67be90a-6797-4fec-97c3-c0a202727de6'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:24 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:24 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:24 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:24 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Deleted volume successfully. Jul 25 02:45:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b0c0efd5-610f-48c2-9d07-6fc2faa59825 tempest-VolumesActionsTest-1799382257 None] Lock "cinder-35683758-d706-40a8-9326-54a10c5eb06f-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (27149d7a-7f96-4dcf-a6a9-67bf1f4cf592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15bd2cb-fff5-4cac-9ea1-b1a9ab8723df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15bd2cb-fff5-4cac-9ea1-b1a9ab8723df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156193425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4281028b-fd68-41b4-8236-2911efdb1a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:25Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744bfc85-34fa-4472-985d-032b36934f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744bfc85-34fa-4472-985d-032b36934f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff45484b-e65b-4e63-b401-6a88962f2f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff45484b-e65b-4e63-b401-6a88962f2f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4281028b-fd68-41b4-8236-2911efdb1a25', 'volume_name': 'volume-4281028b-fd68-41b4-8236-2911efdb1a25', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e9050c-bca3-4355-a6f8-4a1ebd93523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e9050c-bca3-4355-a6f8-4a1ebd93523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f9bce8-03c8-4e26-91ed-cd807cbab62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:25 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Volume 4281028b-fd68-41b4-8236-2911efdb1a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4281028b-fd68-41b4-8236-2911efdb1a25', 'volume_size': 1} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156193425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4281028b-fd68-41b4-8236-2911efdb1a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:25Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Creating volume 4281028b-fd68-41b4-8236-2911efdb1a25 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:25 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:25 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 1073741824 Jul 25 02:45:25 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:26 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 1073741824" returned: 0 in 0.448s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:26 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 Jul 25 02:45:26 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:26 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25" returned: 0 in 0.283s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f9bce8-03c8-4e26-91ed-cd807cbab62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4281028b-fd68-41b4-8236-2911efdb1a25', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e94506-c401-4ced-ba13-33aa3ca67866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:26 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Volume volume-4281028b-fd68-41b4-8236-2911efdb1a25 (4281028b-fd68-41b4-8236-2911efdb1a25): created successfully Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e94506-c401-4ced-ba13-33aa3ca67866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (27149d7a-7f96-4dcf-a6a9-67bf1f4cf592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-12ea1f07-c872-4a25-9191-99750ca3a5c3 tempest-VolumesActionsTest-1725263707 None] Created volume successfully. Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-4281028b-fd68-41b4-8236-2911efdb1a25-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Lock "cinder-4281028b-fd68-41b4-8236-2911efdb1a25-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-quobyte-4281028b-fd68-41b4-8236-2911efdb1a25" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-4281028b-fd68-41b4-8236-2911efdb1a25" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c209cbc4-9c00-4239-84bf-3ff0007dba20]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:26 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 Jul 25 02:45:26 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:27 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:27 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25 Jul 25 02:45:27 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:27 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4281028b-fd68-41b4-8236-2911efdb1a25" returned: 0 in 0.259s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-4281028b-fd68-41b4-8236-2911efdb1a25" released by "delete_volume" :: held 0.688s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Created reservations ['ca504bdd-ea05-4c8f-89ca-a9a8add0da48', '275f57c9-102a-42fb-a5c4-f8c5401fef8b', '3914a05e-51ea-4864-b984-864969d27068', 'afabf65e-6e3c-4408-bebb-8a0a7ae6ed4b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:27 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:27 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:27 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.260s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Deleted volume successfully. Jul 25 02:45:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e0cc8d24-2036-4117-bcf2-d6addfc0088d tempest-VolumesActionsTest-1799382257 None] Lock "cinder-4281028b-fd68-41b4-8236-2911efdb1a25-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (2d8e918b-fdb6-4638-81b5-99271677e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254715ef-0724-464c-bec3-3c477e6fe2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254715ef-0724-464c-bec3-3c477e6fe2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-153279114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5ed853-1856-49e3-8582-ee1157a78daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:28Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da86cf2d-aae8-4235-bc3e-5f03209a3d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da86cf2d-aae8-4235-bc3e-5f03209a3d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6b1bbb-1bc9-496d-a51c-db53a85be298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6b1bbb-1bc9-496d-a51c-db53a85be298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5ed853-1856-49e3-8582-ee1157a78daf', 'volume_name': 'volume-4b5ed853-1856-49e3-8582-ee1157a78daf', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2334ce1-dc70-40a3-8341-79d003a41053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2334ce1-dc70-40a3-8341-79d003a41053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bf1e58-1612-4d3c-921c-ae67d9c3403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:28 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Volume 4b5ed853-1856-49e3-8582-ee1157a78daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5ed853-1856-49e3-8582-ee1157a78daf', 'volume_size': 1} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-153279114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5ed853-1856-49e3-8582-ee1157a78daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:28Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Creating volume 4b5ed853-1856-49e3-8582-ee1157a78daf {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:28 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:28 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf 1073741824 Jul 25 02:45:28 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:28 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf 1073741824" returned: 0 in 0.432s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:28 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf Jul 25 02:45:28 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:29 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf" returned: 0 in 0.257s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bf1e58-1612-4d3c-921c-ae67d9c3403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5ed853-1856-49e3-8582-ee1157a78daf', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dda918-ca3e-456f-879c-e4fc31845c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Volume volume-4b5ed853-1856-49e3-8582-ee1157a78daf (4b5ed853-1856-49e3-8582-ee1157a78daf): created successfully Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dda918-ca3e-456f-879c-e4fc31845c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (2d8e918b-fdb6-4638-81b5-99271677e07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-caeaadf2-830b-48d3-9bb9-9e7d0c2990bd tempest-VolumesActionsTest-1725263707 None] Created volume successfully. Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-4b5ed853-1856-49e3-8582-ee1157a78daf-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Lock "cinder-4b5ed853-1856-49e3-8582-ee1157a78daf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Acquiring lock "cinder-quobyte-4b5ed853-1856-49e3-8582-ee1157a78daf" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-4b5ed853-1856-49e3-8582-ee1157a78daf" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[efda7dbf-f37b-4e15-9c54-86939eaaa723]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:29 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf Jul 25 02:45:29 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:30 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:30 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf Jul 25 02:45:30 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b5ed853-1856-49e3-8582-ee1157a78daf" returned: 0 in 0.285s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:30 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Lock "cinder-quobyte-4b5ed853-1856-49e3-8582-ee1157a78daf" released by "delete_volume" :: held 0.690s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Created reservations ['bb2b47ad-18bc-46d9-b2ad-5febbac84077', '19c289c2-2412-4a29-893d-9e68da85211c', '3cf4a3e3-beb3-45ec-84d3-698c3ecaba34', '480857f1-d9de-40fa-8043-5bb37b64f58a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:30 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:30 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:30 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.295s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:30 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Deleted volume successfully. Jul 25 02:45:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-72e55466-32f1-4e69-8d24-1b8c4e58f24f tempest-VolumesActionsTest-1799382257 None] Lock "cinder-4b5ed853-1856-49e3-8582-ee1157a78daf-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (162c85ac-c0eb-440f-8438-6cb90088ec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c7220e-7a8f-4d20-864c-41236d707901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c7220e-7a8f-4d20-864c-41236d707901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-439579526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b27d33-1d5b-49af-a680-511dfeac8f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:31Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a16813-ad7f-4ca2-998e-7c2de1dc9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a16813-ad7f-4ca2-998e-7c2de1dc9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee14b00-d5ab-452c-ad08-bb39ce153c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee14b00-d5ab-452c-ad08-bb39ce153c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b27d33-1d5b-49af-a680-511dfeac8f54', 'volume_name': 'volume-93b27d33-1d5b-49af-a680-511dfeac8f54', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84e0022-4dfa-4c47-8bdf-88ad5688d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84e0022-4dfa-4c47-8bdf-88ad5688d741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7420b48b-8a6b-4d68-87f7-94d364cadbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Volume 93b27d33-1d5b-49af-a680-511dfeac8f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b27d33-1d5b-49af-a680-511dfeac8f54', 'volume_size': 1} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-439579526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b27d33-1d5b-49af-a680-511dfeac8f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730f3d669b0c488ba57e2af17d4a7b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:31Z,use_quota=True,user_id='06c883076afa4fb1b3b10389201cf152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Creating volume 93b27d33-1d5b-49af-a680-511dfeac8f54 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:31 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:31 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 1073741824 Jul 25 02:45:31 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:31 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 1073741824" returned: 0 in 0.418s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:31 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 Jul 25 02:45:31 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:32 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54" returned: 0 in 0.245s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7420b48b-8a6b-4d68-87f7-94d364cadbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b27d33-1d5b-49af-a680-511dfeac8f54', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a61eca9-2d78-4e57-8935-2a9de6492507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Volume volume-93b27d33-1d5b-49af-a680-511dfeac8f54 (93b27d33-1d5b-49af-a680-511dfeac8f54): created successfully Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a61eca9-2d78-4e57-8935-2a9de6492507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Flow 'volume_create_manager' (162c85ac-c0eb-440f-8438-6cb90088ec05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4262953f-bd29-4808-8c52-14dd8dbbd330 tempest-VolumesActionsTest-1725263707 None] Created volume successfully. Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "cinder-93b27d33-1d5b-49af-a680-511dfeac8f54-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-93b27d33-1d5b-49af-a680-511dfeac8f54-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "cinder-quobyte-93b27d33-1d5b-49af-a680-511dfeac8f54" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-quobyte-93b27d33-1d5b-49af-a680-511dfeac8f54" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[70791883-23d8-465c-97a4-5feae167003e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:33 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 Jul 25 02:45:33 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:33 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54" returned: 0 in 0.355s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:33 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54 Jul 25 02:45:33 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:33 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-93b27d33-1d5b-49af-a680-511dfeac8f54" returned: 0 in 0.248s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-quobyte-93b27d33-1d5b-49af-a680-511dfeac8f54" released by "delete_volume" :: held 0.637s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Created reservations ['c18e4122-fd21-4033-98b5-334efb3cb38c', '254c513f-34c1-46f8-ab56-59976deaedb0', '176c0046-7bc4-4749-99b4-6b4971e017f7', '99cc6f0a-eea2-4100-b852-9f5af56a378d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:33 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:33 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:34 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Deleted volume successfully. Jul 25 02:45:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e14e1762-a9fd-497d-9ce5-6d98a1b66d98 tempest-VolumesActionsTest-1725263707 None] Lock "cinder-93b27d33-1d5b-49af-a680-511dfeac8f54-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:43 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=69,cinder:SELECT=54,cinder:INSERT=15,cinder:DELETE=3 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:45:44 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=45,cinder:INSERT=17,cinder:UPDATE=70,cinder:DELETE=9 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:45:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-831381d5-46bd-4360-b17f-d3e4f9733ab4 req-9aa9a6b9-10e2-4e3c-8bd4-1fd7fa9a3686 tempest-TestMinimumBasicScenario-421814732 None] Terminate volume connection completed successfully. Jul 25 02:45:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-831381d5-46bd-4360-b17f-d3e4f9733ab4 req-9aa9a6b9-10e2-4e3c-8bd4-1fd7fa9a3686 tempest-TestMinimumBasicScenario-421814732 None] Deleting attachment 9c39391b-539b-4304-8b3c-e6fd9818a17e. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Acquiring lock "cinder-37caaf85-0190-44ff-a332-18f07dee74d0-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Lock "cinder-37caaf85-0190-44ff-a332-18f07dee74d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Acquiring lock "cinder-quobyte-37caaf85-0190-44ff-a332-18f07dee74d0" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Lock "cinder-quobyte-37caaf85-0190-44ff-a332-18f07dee74d0" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab6311-7976-41ee-9d18-7260098c3232]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:46 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 Jul 25 02:45:46 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:46 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0" returned: 0 in 0.373s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:46 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0 Jul 25 02:45:46 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:47 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-37caaf85-0190-44ff-a332-18f07dee74d0" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Lock "cinder-quobyte-37caaf85-0190-44ff-a332-18f07dee74d0" released by "delete_volume" :: held 0.683s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Flow 'volume_create_manager' (054c84dd-1dd9-4cec-a53d-c89af33be567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2f79f1-9d6f-4d7f-978b-0b2db07b9508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2f79f1-9d6f-4d7f-978b-0b2db07b9508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-39273675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c187799-cb7e-4dda-a765-4d457f546a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80771c4f886747549dbb77038334ecdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:47Z,use_quota=True,user_id='47581b8fd7614d87bf0ddb97bb6e2acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd9f31e-7cff-4cf6-917f-d92c1a2046f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd9f31e-7cff-4cf6-917f-d92c1a2046f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf9c427-475d-415f-97c5-1ac3bff5d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Created reservations ['f0fb3008-e23c-415b-8155-943663fa9f85', 'c8998403-7543-4d5a-abda-c8970685f44f', 'bab94e6a-541c-49ef-abc5-c6a74ac146bc', 'dc5dc212-822d-45ea-9326-da54d011f4d5'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:47 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:47 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf9c427-475d-415f-97c5-1ac3bff5d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c187799-cb7e-4dda-a765-4d457f546a6f', 'volume_name': 'volume-9c187799-cb7e-4dda-a765-4d457f546a6f', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d69cd8-25da-48a2-b36f-130d6b413039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d69cd8-25da-48a2-b36f-130d6b413039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31af389-5377-44bd-a80e-0430b31d59fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:47 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Volume 9c187799-cb7e-4dda-a765-4d457f546a6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c187799-cb7e-4dda-a765-4d457f546a6f', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Trying to clone 9c187799-cb7e-4dda-a765-4d457f546a6f from image 19c99a4c-891e-4766-a74f-7e24d755618e at location (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:45:47 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.278s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:47 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Deleted volume successfully. Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-68e83bbf-0bc8-4397-b004-99ef49cf5da4 tempest-TestMinimumBasicScenario-421814732 None] Lock "cinder-37caaf85-0190-44ff-a332-18f07dee74d0-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:45:47 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Image download 20.69 MB at 20.69 MB/s Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[377ccb88-3659-496c-84b7-2329fd8ae2ba]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:47 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD Jul 25 02:45:47 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:48 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e is fetched for user 47581b8fd7614d87bf0ddb97bb6e2acc. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3315b57-9ee7-4794-bf6b-28388af3912a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:48 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD Jul 25 02:45:48 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:48 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-39273675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c187799-cb7e-4dda-a765-4d457f546a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80771c4f886747549dbb77038334ecdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:45:47Z,use_quota=True,user_id='47581b8fd7614d87bf0ddb97bb6e2acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Creating volume 9c187799-cb7e-4dda-a765-4d457f546a6f {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:48 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:48 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f 1073741824 Jul 25 02:45:48 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:49 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f 1073741824" returned: 0 in 0.539s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:49 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f Jul 25 02:45:49 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:49 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Attempting download of 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume 9c187799-cb7e-4dda-a765-4d457f546a6f. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c965ad-6a40-423c-86b2-36bfd38efa92]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:49 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi Jul 25 02:45:49 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:49 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi" returned: 0 in 0.315s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:50 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi Jul 25 02:45:50 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:50 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi" returned: 1 in 0.335s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_slu3n9mi' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95e758-4b20-4786-847b-4f4845511414]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:50 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD Jul 25 02:45:50 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:50 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] 19c99a4c-891e-4766-a74f-7e24d755618e was qcow2, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:50 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f Jul 25 02:45:50 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:50 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:50 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:51 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.297s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:45:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:45:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:45:52 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f" returned: 0 in 1.758s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_7sn5wtladevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:45:52 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Converted 112.00 MB image at 63.67 MB/s Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:52 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f 1G Jul 25 02:45:52 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:52 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f 1G" returned: 0 in 0.324s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Downloaded image 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume 9c187799-cb7e-4dda-a765-4d457f546a6f successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e for user 47581b8fd7614d87bf0ddb97bb6e2acc is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Marking volume 9c187799-cb7e-4dda-a765-4d457f546a6f as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Copying metadata from image 19c99a4c-891e-4766-a74f-7e24d755618e to 9c187799-cb7e-4dda-a765-4d457f546a6f. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Creating volume glance metadata for volume 9c187799-cb7e-4dda-a765-4d457f546a6f backed by image 19c99a4c-891e-4766-a74f-7e24d755618e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31af389-5377-44bd-a80e-0430b31d59fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c187799-cb7e-4dda-a765-4d457f546a6f', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5364b3d2-4983-40bf-9d54-06405b44f63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:52 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Volume volume-9c187799-cb7e-4dda-a765-4d457f546a6f (9c187799-cb7e-4dda-a765-4d457f546a6f): created successfully Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5364b3d2-4983-40bf-9d54-06405b44f63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:52 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Flow 'volume_create_manager' (054c84dd-1dd9-4cec-a53d-c89af33be567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dd95b147-4011-4da5-907f-65118d72501d tempest-VolumesImageMetadata-1180143783 None] Created volume successfully. Jul 25 02:45:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Acquiring lock "cinder-9c187799-cb7e-4dda-a765-4d457f546a6f-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Lock "cinder-9c187799-cb7e-4dda-a765-4d457f546a6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Acquiring lock "cinder-quobyte-9c187799-cb7e-4dda-a765-4d457f546a6f" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:45:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Lock "cinder-quobyte-9c187799-cb7e-4dda-a765-4d457f546a6f" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:45:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdb8c65-7c5e-4469-ab9e-17172ed77758]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:45:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:53 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f Jul 25 02:45:53 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:54 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f" returned: 0 in 0.369s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:54 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f Jul 25 02:45:54 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:54 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9c187799-cb7e-4dda-a765-4d457f546a6f" returned: 0 in 0.237s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Lock "cinder-quobyte-9c187799-cb7e-4dda-a765-4d457f546a6f" released by "delete_volume" :: held 0.648s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Created reservations ['49bdf9ad-bcad-411b-b926-3a7e18ac8a50', '74c1fb18-7273-4450-82d1-5de625faee81', 'c59ff2c3-690d-4d9a-8967-0f5354db7180', '02f8f3a4-27f6-4c82-bf8f-13707e8c0317'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:54 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:45:54 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:45:54 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.276s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:45:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Deleted volume successfully. Jul 25 02:45:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d66c9018-89dd-4c0e-9615-f7d99590f1ad tempest-VolumesImageMetadata-1180143783 None] Lock "cinder-9c187799-cb7e-4dda-a765-4d457f546a6f-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Flow 'volume_create_manager' (220417c9-bb03-4d3c-97c8-bb2bb8676660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df511ac9-ec6d-4326-ab7e-d67295aefb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df511ac9-ec6d-4326-ab7e-d67295aefb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-569095460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75571c7-75ea-4b9f-8b62-0399b1960f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add108ce0d354654ab259bdb96fabebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:00Z,use_quota=True,user_id='90e0b74bb4dc4a5cbd9ad6ad745e261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994ec9e5-8193-4a33-adef-6419ba6b272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994ec9e5-8193-4a33-adef-6419ba6b272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdb0fdb-7ecb-4662-92d6-ea5d3892cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdb0fdb-7ecb-4662-92d6-ea5d3892cb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75571c7-75ea-4b9f-8b62-0399b1960f0d', 'volume_name': 'volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3112e1-739d-47c7-8c19-5735731ca1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3112e1-739d-47c7-8c19-5735731ca1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cac86bd-09bd-422f-8636-598de7e5828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:45:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Volume e75571c7-75ea-4b9f-8b62-0399b1960f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d', 'volume_size': 1} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-569095460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75571c7-75ea-4b9f-8b62-0399b1960f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add108ce0d354654ab259bdb96fabebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:00Z,use_quota=True,user_id='90e0b74bb4dc4a5cbd9ad6ad745e261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Creating volume e75571c7-75ea-4b9f-8b62-0399b1960f0d {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:45:59 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:45:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:45:59 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d 1073741824 Jul 25 02:45:59 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:00 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d 1073741824" returned: 0 in 0.443s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:00 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d Jul 25 02:46:00 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:00 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cac86bd-09bd-422f-8636-598de7e5828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b9f2bf-2743-4b1e-b3ba-3356160ca2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Volume volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d (e75571c7-75ea-4b9f-8b62-0399b1960f0d): created successfully Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b9f2bf-2743-4b1e-b3ba-3356160ca2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Flow 'volume_create_manager' (220417c9-bb03-4d3c-97c8-bb2bb8676660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c6f98d25-e575-4539-8be0-ae3161235fff tempest-VolumesTransfersV355Test-1802662254 None] Created volume successfully. Jul 25 02:46:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5ee31446-4584-4918-98c0-c534ebaf2aff tempest-VolumesTransfersV355Test-922261449 None] Transfer volume completed successfully. Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Acquiring lock "cinder-e75571c7-75ea-4b9f-8b62-0399b1960f0d-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-e75571c7-75ea-4b9f-8b62-0399b1960f0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Acquiring lock "cinder-quobyte-e75571c7-75ea-4b9f-8b62-0399b1960f0d" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-quobyte-e75571c7-75ea-4b9f-8b62-0399b1960f0d" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f1ac6-24fa-495e-b617-67e1323ee7fd]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:02 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d Jul 25 02:46:02 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:02 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:02 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d Jul 25 02:46:02 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:02 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e75571c7-75ea-4b9f-8b62-0399b1960f0d" returned: 0 in 0.276s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-quobyte-e75571c7-75ea-4b9f-8b62-0399b1960f0d" released by "delete_volume" :: held 0.706s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:02 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Created reservations ['cc570719-c947-4050-99c9-38c7fc620e6a', '74fbb29d-786d-40fe-95d5-49f2a0318720', '368cb69f-7677-4638-bcd2-8406fb0fd6c9', '7cde4b0b-cdc4-428e-8bf3-919ade5a875b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:03 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:46:03 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:03 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:46:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Deleted volume successfully. Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ed947281-2914-4894-98f9-0441c07724f8 tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-e75571c7-75ea-4b9f-8b62-0399b1960f0d-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Flow 'volume_create_manager' (c7064a34-4873-4bc4-998f-cd42b9a4a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55570384-ebad-4cc2-9de5-1b8ccaca327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55570384-ebad-4cc2-9de5-1b8ccaca327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-244133574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789d1da9-8d81-4ca4-9c23-95806a824927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add108ce0d354654ab259bdb96fabebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:04Z,use_quota=True,user_id='90e0b74bb4dc4a5cbd9ad6ad745e261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022fbed9-fdfa-4731-8e60-db460f3f09f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022fbed9-fdfa-4731-8e60-db460f3f09f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de76296-d4df-41cd-bec5-12a169874210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de76296-d4df-41cd-bec5-12a169874210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789d1da9-8d81-4ca4-9c23-95806a824927', 'volume_name': 'volume-789d1da9-8d81-4ca4-9c23-95806a824927', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ffe726-2e99-4d74-aa8a-bdf472ac1416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ffe726-2e99-4d74-aa8a-bdf472ac1416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1580b4-99a4-42be-8b7c-c254aebd5a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Volume 789d1da9-8d81-4ca4-9c23-95806a824927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789d1da9-8d81-4ca4-9c23-95806a824927', 'volume_size': 1} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-244133574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789d1da9-8d81-4ca4-9c23-95806a824927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add108ce0d354654ab259bdb96fabebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:04Z,use_quota=True,user_id='90e0b74bb4dc4a5cbd9ad6ad745e261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Creating volume 789d1da9-8d81-4ca4-9c23-95806a824927 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:46:03 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:46:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:03 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 1073741824 Jul 25 02:46:03 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:04 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 1073741824" returned: 0 in 0.436s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:04 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 Jul 25 02:46:04 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:04 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1580b4-99a4-42be-8b7c-c254aebd5a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789d1da9-8d81-4ca4-9c23-95806a824927', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c659c8d3-dd7b-41e1-b03c-52aec8b4ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Volume volume-789d1da9-8d81-4ca4-9c23-95806a824927 (789d1da9-8d81-4ca4-9c23-95806a824927): created successfully Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c659c8d3-dd7b-41e1-b03c-52aec8b4ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Flow 'volume_create_manager' (c7064a34-4873-4bc4-998f-cd42b9a4a45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a95c5bb0-7e66-4a85-b35c-853c9b177a99 tempest-VolumesTransfersV355Test-1802662254 None] Created volume successfully. Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Acquiring lock "cinder-789d1da9-8d81-4ca4-9c23-95806a824927-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-789d1da9-8d81-4ca4-9c23-95806a824927-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Acquiring lock "cinder-quobyte-789d1da9-8d81-4ca4-9c23-95806a824927" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-quobyte-789d1da9-8d81-4ca4-9c23-95806a824927" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7c52e-8f79-41bb-96cd-d16e5a427bde]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:05 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 Jul 25 02:46:05 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:05 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:05 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927 Jul 25 02:46:05 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:05 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-789d1da9-8d81-4ca4-9c23-95806a824927" returned: 0 in 0.253s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-quobyte-789d1da9-8d81-4ca4-9c23-95806a824927" released by "delete_volume" :: held 0.703s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Created reservations ['1027594c-578a-464b-9b75-7f949717557a', 'dc449b99-5e4d-4408-bafc-aef40984449c', 'deb49fe9-9566-48b4-9e11-33b51718d8fc', 'a3553fea-84e6-4147-bfd8-ff0ecc74ccbb'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:06 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:46:06 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:06 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:46:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Deleted volume successfully. Jul 25 02:46:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3d9d2bb4-9392-4563-a817-904fc715102b tempest-VolumesTransfersV355Test-247303201 None] Lock "cinder-789d1da9-8d81-4ca4-9c23-95806a824927-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Flow 'volume_create_manager' (148681cb-b68a-448a-8bbf-941b69d30671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6c358-bc9b-456b-ac3c-d71eb448ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6c358-bc9b-456b-ac3c-d71eb448ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-84389560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c526fd30-8137-491f-9d15-b6c1aa32bea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58c5d8c0fe34c2cb4fbcdf114a8c913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:13Z,use_quota=True,user_id='239a682b933044ad83ec09563674964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14a241-f6fa-4bf8-8a1f-fe18e744a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14a241-f6fa-4bf8-8a1f-fe18e744a665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925cc72-d396-4a94-a53b-4298f97b3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925cc72-d396-4a94-a53b-4298f97b3a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c526fd30-8137-491f-9d15-b6c1aa32bea3', 'volume_name': 'volume-c526fd30-8137-491f-9d15-b6c1aa32bea3', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5ba5c4-0d8f-41cb-a9e8-c88b843e895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5ba5c4-0d8f-41cb-a9e8-c88b843e895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58382c5c-3170-40ab-b969-28761dbc64ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:13 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Volume c526fd30-8137-491f-9d15-b6c1aa32bea3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c526fd30-8137-491f-9d15-b6c1aa32bea3', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Trying to clone c526fd30-8137-491f-9d15-b6c1aa32bea3 from image 19c99a4c-891e-4766-a74f-7e24d755618e at location (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:46:13 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Image download 20.69 MB at 20.69 MB/s Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa8c39-7a86-40f8-8950-e2c4f3203090]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:13 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD Jul 25 02:46:13 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:14 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e is fetched for user 239a682b933044ad83ec09563674964a. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f009f3d6-6ee3-4e59-a73f-8ea9b35e02e7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:14 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD Jul 25 02:46:14 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:14 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-84389560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c526fd30-8137-491f-9d15-b6c1aa32bea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58c5d8c0fe34c2cb4fbcdf114a8c913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:13Z,use_quota=True,user_id='239a682b933044ad83ec09563674964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Creating volume c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:46:14 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:46:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:14 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 1073741824 Jul 25 02:46:14 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:15 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 1073741824" returned: 0 in 0.502s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:15 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 Jul 25 02:46:15 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:15 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3" returned: 0 in 0.305s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Attempting download of 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume c526fd30-8137-491f-9d15-b6c1aa32bea3. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9632442-f39b-408a-8f1c-25745e547c4d]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:15 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b Jul 25 02:46:15 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:15 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b" returned: 0 in 0.372s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:16 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b Jul 25 02:46:16 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:16 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b" returned: 1 in 0.338s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_l2j68h7b' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6b6618-9bff-443a-be2e-bf89f2f4341e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:16 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD Jul 25 02:46:16 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:16 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] 19c99a4c-891e-4766-a74f-7e24d755618e was qcow2, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:46:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:16 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 Jul 25 02:46:16 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Flow 'volume_create_manager' (4cab47b1-1d94-4de0-a133-b6c78b0c3fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670859a0-4b4e-4da7-957d-e71b21a208ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670859a0-4b4e-4da7-957d-e71b21a208ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-924318367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131ca3ab-7e10-4a51-9da3-bc3c7f2221ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c1d83a58cb45998cf33c4ae3e2e9f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:18Z,use_quota=True,user_id='7b661131d25242ccbd82531df373d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a9df85-7974-4346-b4b2-5f8936757394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a9df85-7974-4346-b4b2-5f8936757394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5dff673-6600-41ad-ae65-f1b308247547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5dff673-6600-41ad-ae65-f1b308247547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131ca3ab-7e10-4a51-9da3-bc3c7f2221ee', 'volume_name': 'volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1002b6d5-4b71-497b-a060-4c6fe97e951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1002b6d5-4b71-497b-a060-4c6fe97e951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa185c0-ec53-401c-a714-c56becb5597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:18 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Volume 131ca3ab-7e10-4a51-9da3-bc3c7f2221ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee', 'volume_size': 1} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-924318367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131ca3ab-7e10-4a51-9da3-bc3c7f2221ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c1d83a58cb45998cf33c4ae3e2e9f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:18Z,use_quota=True,user_id='7b661131d25242ccbd82531df373d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Creating volume 131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:46:18 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:18 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee 1073741824 Jul 25 02:46:18 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:18 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3" returned: 0 in 2.074s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_hc0njt5udevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:46:18 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Converted 112.00 MB image at 53.95 MB/s Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:18 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 1G Jul 25 02:46:18 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:18 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee 1073741824" returned: 0 in 0.439s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:18 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee Jul 25 02:46:18 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:19 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 1G" returned: 0 in 0.332s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Downloaded image 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume c526fd30-8137-491f-9d15-b6c1aa32bea3 successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e for user 239a682b933044ad83ec09563674964a is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Marking volume c526fd30-8137-491f-9d15-b6c1aa32bea3 as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Copying metadata from image 19c99a4c-891e-4766-a74f-7e24d755618e to c526fd30-8137-491f-9d15-b6c1aa32bea3. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Creating volume glance metadata for volume c526fd30-8137-491f-9d15-b6c1aa32bea3 backed by image 19c99a4c-891e-4766-a74f-7e24d755618e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:46:19 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" returned: 0 in 0.275s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa185c0-ec53-401c-a714-c56becb5597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170eeee5-fc97-40cd-a633-a5a814b38bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58382c5c-3170-40ab-b969-28761dbc64ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c526fd30-8137-491f-9d15-b6c1aa32bea3', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b25d763-f985-4f61-a63c-575581070cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Volume volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee (131ca3ab-7e10-4a51-9da3-bc3c7f2221ee): created successfully Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170eeee5-fc97-40cd-a633-a5a814b38bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Flow 'volume_create_manager' (4cab47b1-1d94-4de0-a133-b6c78b0c3fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Volume volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 (c526fd30-8137-491f-9d15-b6c1aa32bea3): created successfully Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b25d763-f985-4f61-a63c-575581070cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Flow 'volume_create_manager' (148681cb-b68a-448a-8bbf-941b69d30671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ee32612b-d2bf-488b-864d-b194ccc1fbc4 tempest-TestImageHashVerification-1546900513 None] Created volume successfully. Jul 25 02:46:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f5783489-f1ce-419d-a3dd-ff509920ae97 tempest-VolumesExtendTest-360219039 None] Created volume successfully. Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4470a4e-c485-4a07-8da3-0418b42c750e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:19 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 Jul 25 02:46:19 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:19 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3" returned: 0 in 0.349s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 2G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 2G" returned: 0 in 0.095s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.466s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6faeb666-6d88-47f4-a1e7-25f2fcef28fb tempest-VolumesExtendTest-360219039 None] Extend volume completed successfully. Jul 25 02:46:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-c526fd30-8137-491f-9d15-b6c1aa32bea3-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Lock "cinder-c526fd30-8137-491f-9d15-b6c1aa32bea3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-quobyte-c526fd30-8137-491f-9d15-b6c1aa32bea3" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-c526fd30-8137-491f-9d15-b6c1aa32bea3" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:20 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927b5da-90a0-4e45-a918-52de715b230d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:21 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 Jul 25 02:46:21 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df3d81-9c28-43f3-947c-2375fd7e7c53]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:21 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3" returned: 0 in 0.370s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:21 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3 Jul 25 02:46:21 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:21 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee Jul 25 02:46:21 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:21 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c526fd30-8137-491f-9d15-b6c1aa32bea3" returned: 0 in 0.248s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-c526fd30-8137-491f-9d15-b6c1aa32bea3" released by "delete_volume" :: held 0.659s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Created reservations ['51cf9709-3b8e-415f-803e-ee42223c06e2', '45d3e060-967a-42ec-9b23-eb9af858d08f', 'ada26121-ad4a-4d55-9818-40417c574f94', '263beb67-e54f-4dfa-a20a-9b8e802f07f4'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:46:21 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" returned: 0 in 0.403s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[569c268f-45fb-4be7-92c0-53868124e3c8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:21 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:46:21 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:21 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee Jul 25 02:46:21 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:21 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.256s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:46:21 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Deleted volume successfully. Jul 25 02:46:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-fb69a67b-9a77-4cd1-9cf9-cce973dbdf40 tempest-VolumesExtendTest-360219039 None] Lock "cinder-c526fd30-8137-491f-9d15-b6c1aa32bea3-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:22 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" returned: 0 in 0.410s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee /opt/stack/data/cinder/conversion/131ca3ab-7e10-4a51-9da3-bc3c7f2221ee.temp_image.9e422bd4-5ed7-4d69-90c3-4ad14edb2945js5pt4q8.img {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:22 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee /opt/stack/data/cinder/conversion/131ca3ab-7e10-4a51-9da3-bc3c7f2221ee.temp_image.9e422bd4-5ed7-4d69-90c3-4ad14edb2945js5pt4q8.img Jul 25 02:46:22 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Flow 'volume_create_manager' (610c0895-1650-47fc-a027-b6a2cb6c5617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf8ae62-c473-46f0-a436-6bc343813009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf8ae62-c473-46f0-a436-6bc343813009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1401259439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1066933-9f8a-4ce3-8ded-78ee1f95e1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58c5d8c0fe34c2cb4fbcdf114a8c913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:22Z,use_quota=True,user_id='239a682b933044ad83ec09563674964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc546cea-ac23-496e-8040-7f5b3440f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc546cea-ac23-496e-8040-7f5b3440f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1f836-1354-4ada-9676-790e5fef334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1f836-1354-4ada-9676-790e5fef334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1066933-9f8a-4ce3-8ded-78ee1f95e1e8', 'volume_name': 'volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63f461-5ce9-4727-b7fc-f88d03fb48b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63f461-5ce9-4727-b7fc-f88d03fb48b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b421c58-0922-4110-988d-e2c99adf0b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Volume b1066933-9f8a-4ce3-8ded-78ee1f95e1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8', 'volume_size': 1} Jul 25 02:46:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:26 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee /opt/stack/data/cinder/conversion/131ca3ab-7e10-4a51-9da3-bc3c7f2221ee.temp_image.9e422bd4-5ed7-4d69-90c3-4ad14edb2945js5pt4q8.img" returned: 0 in 4.134s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a12e4c3-78af-4e10-aa98-c68cec8365dc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:26 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee Jul 25 02:46:26 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:26 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" returned: 0 in 0.547s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:26 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/conversion/131ca3ab-7e10-4a51-9da3-bc3c7f2221ee.temp_image.9e422bd4-5ed7-4d69-90c3-4ad14edb2945js5pt4q8.img {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:46:26 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Converted 1024.00 MB image at 247.61 MB/s Jul 25 02:46:26 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] 9e422bd4-5ed7-4d69-90c3-4ad14edb2945 was raw, no need to convert to raw {{(pid=88279) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 25 02:46:32 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=57,cinder:INSERT=25,cinder:UPDATE=61,cinder:DELETE=3 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:46:36 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=55,cinder:UPDATE=62,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.776s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Uploaded volume to glance image-id: 9e422bd4-5ed7-4d69-90c3-4ad14edb2945. {{(pid=88279) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.213s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1401259439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1066933-9f8a-4ce3-8ded-78ee1f95e1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58c5d8c0fe34c2cb4fbcdf114a8c913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:22Z,use_quota=True,user_id='239a682b933044ad83ec09563674964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Creating volume b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:46:44 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:46:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:44 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 1073741824 Jul 25 02:46:44 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a0b3a00f-d7a9-4f63-b529-0324f19c3fa2 tempest-TestImageHashVerification-1546900513 None] Copy volume to image completed successfully. Jul 25 02:46:45 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 1073741824" returned: 0 in 0.456s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:45 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 Jul 25 02:46:45 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Acquiring lock "cinder-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Lock "cinder-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Acquiring lock "cinder-quobyte-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:45 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Lock "cinder-quobyte-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2c938b-dcb3-45bd-a8ba-edc1890a38c4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b421c58-0922-4110-988d-e2c99adf0b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee520f2-945e-4600-9e2d-ba2dce951dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:45 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Volume volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 (b1066933-9f8a-4ce3-8ded-78ee1f95e1e8): created successfully Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee520f2-945e-4600-9e2d-ba2dce951dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:45 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Flow 'volume_create_manager' (610c0895-1650-47fc-a027-b6a2cb6c5617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-5823fe86-ddd5-41ab-ade2-e24cbfabb5d6 tempest-VolumesExtendTest-360219039 None] Created volume successfully. Jul 25 02:46:45 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee Jul 25 02:46:45 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:46 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:46 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee Jul 25 02:46:46 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:46 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Lock "cinder-quobyte-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee" released by "delete_volume" :: held 0.650s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Created reservations ['444e6f95-a1d9-480d-98e6-dcea88f2815d', '6fa4f984-bdac-4a6c-97c5-39ff75bd50ba', '7d213470-b092-42ec-a058-f853c4522f48', 'eca716d2-ef43-496f-a086-638bd2e97f51'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Creating offline snapshot d916c4d9-61c0-483f-bd72-f0439b0a8d51 of volume b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c7cd9-d093-4dfe-9824-0261afbc03af]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:46 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:46:46 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:46 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 Jul 25 02:46:46 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:46 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.257s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:46:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Deleted volume successfully. Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-35167b97-bf46-4677-88ba-1dfc9974cfed tempest-TestImageHashVerification-1546900513 None] Lock "cinder-131ca3ab-7e10-4a51-9da3-bc3c7f2221ee-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:46 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" returned: 0 in 0.378s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:46 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 1G Jul 25 02:46:46 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:47 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 1G" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:47 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 Jul 25 02:46:47 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:47 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:47 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 is being set with open permissions: ugo+rw Jul 25 02:46:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:47 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 Jul 25 02:46:47 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:47 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:48 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info Jul 25 02:46:48 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:48 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:48 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info is being set with open permissions: ugo+rw Jul 25 02:46:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:48 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info Jul 25 02:46:48 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:48 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.info" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1e4d4727-8765-43bb-b442-d3edb94d77a9 tempest-VolumesExtendTest-360219039 None] Create snapshot completed successfully Jul 25 02:46:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc93faf-296b-48e4-8ae5-79058e4b2818]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:49 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 Jul 25 02:46:49 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:50 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" returned: 0 in 0.416s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 2G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 2G" returned: 0 in 0.150s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.623s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e324405c-10d1-4622-868a-a3dc0fb42c38 tempest-VolumesExtendTest-360219039 None] Extend volume completed successfully. Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:50 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:46:50 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-d916c4d9-61c0-483f-bd72-f0439b0a8d51-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Lock "cinder-d916c4d9-61c0-483f-bd72-f0439b0a8d51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-quobyte-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-quobyte-d916c4d9-61c0-483f-bd72-f0439b0a8d51" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-d916c4d9-61c0-483f-bd72-f0439b0a8d51" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Deleting offline snapshot d916c4d9-61c0-483f-bd72-f0439b0a8d51 of volume b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:46:51 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] snapshot_file for this snap is: volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.316s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a61196-523e-456f-a8b0-8d74ccddc174]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:51 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 Jul 25 02:46:51 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:51 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51" returned: 0 in 0.367s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[70553081-e52a-4ccd-8f91-f2b0aefed393]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:51 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 Jul 25 02:46:51 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:51 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:51 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 Jul 25 02:46:51 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:52 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:52 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51 Jul 25 02:46:52 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:52 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8.d916c4d9-61c0-483f-bd72-f0439b0a8d51" returned: 0 in 0.307s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-d916c4d9-61c0-483f-bd72-f0439b0a8d51" released by "_delete_snapshot" :: held 1.548s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" released by "delete_snapshot" :: held 1.575s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Created reservations ['78048a3e-e226-4210-9596-c3c74250a491', '50ded01b-c132-409f-abc3-a14d43a4f4f4', 'dbcdd308-ccb2-4982-99ce-e6ff34dadcbb', 'b838df6b-76ee-429b-84ff-26707c3c4106'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:46:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Delete snapshot completed successfully. Jul 25 02:46:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b45449e3-23fb-489d-aa52-a7fce8fbd79e tempest-VolumesExtendTest-360219039 None] Lock "cinder-d916c4d9-61c0-483f-bd72-f0439b0a8d51-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Lock "cinder-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Acquiring lock "cinder-quobyte-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d1dd4-e296-41a3-80a0-0f5a41446b3c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:53 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 Jul 25 02:46:53 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:53 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:53 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8 Jul 25 02:46:53 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:54 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Lock "cinder-quobyte-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8" released by "delete_volume" :: held 0.753s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Created reservations ['3f048663-2823-40ec-98e8-4beddbe9af0a', '3c1ab574-89b4-43cc-b0ef-a25351bd8779', '9175e688-fc51-4f22-a87e-d1e695d841bd', '55115be2-0542-4c8d-987e-9b2ae87651fc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:54 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:46:54 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:54 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:46:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Deleted volume successfully. Jul 25 02:46:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec14a3b0-0ab1-4a09-9099-dc4113a40ee7 tempest-VolumesExtendTest-360219039 None] Lock "cinder-b1066933-9f8a-4ce3-8ded-78ee1f95e1e8-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Flow 'volume_create_manager' (26ead933-cb68-4d11-9402-bed2f48a6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daeae7f7-195a-4f48-a766-c9cd430d3519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daeae7f7-195a-4f48-a766-c9cd430d3519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112278669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea56198-00d0-4056-91d1-9fb29a086f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79103f6257841bb9f13b2516315ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:58Z,use_quota=True,user_id='092ee6e263254f43b26c848fd7d54cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73193a1c-e4b4-44b3-9424-b0128e8ef919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73193a1c-e4b4-44b3-9424-b0128e8ef919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba69391c-6ec1-4ed9-88eb-4739b4873805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba69391c-6ec1-4ed9-88eb-4739b4873805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea56198-00d0-4056-91d1-9fb29a086f6c', 'volume_name': 'volume-0ea56198-00d0-4056-91d1-9fb29a086f6c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e6a71-8db2-42d6-b199-0f76dab41a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e6a71-8db2-42d6-b199-0f76dab41a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46083720-6c99-4441-b967-22736ae9fa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:57 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Volume 0ea56198-00d0-4056-91d1-9fb29a086f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea56198-00d0-4056-91d1-9fb29a086f6c', 'volume_size': 1} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112278669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea56198-00d0-4056-91d1-9fb29a086f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79103f6257841bb9f13b2516315ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:46:58Z,use_quota=True,user_id='092ee6e263254f43b26c848fd7d54cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Creating volume 0ea56198-00d0-4056-91d1-9fb29a086f6c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:46:57 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:46:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:58 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c 1073741824 Jul 25 02:46:58 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:58 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c 1073741824" returned: 0 in 0.457s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:46:58 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c Jul 25 02:46:58 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:46:58 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46083720-6c99-4441-b967-22736ae9fa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea56198-00d0-4056-91d1-9fb29a086f6c', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da2416b-fc58-4a0a-bf65-b3024cf90b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:46:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Volume volume-0ea56198-00d0-4056-91d1-9fb29a086f6c (0ea56198-00d0-4056-91d1-9fb29a086f6c): created successfully Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da2416b-fc58-4a0a-bf65-b3024cf90b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:46:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Flow 'volume_create_manager' (26ead933-cb68-4d11-9402-bed2f48a6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:46:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4d5a7944-3b76-458d-902e-c48f6d09f1ac tempest-ProjectReaderTests-1704105140 None] Created volume successfully. Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Acquiring lock "cinder-0ea56198-00d0-4056-91d1-9fb29a086f6c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Flow 'volume_create_manager' (efddf8f4-2524-48ec-8caf-fabb5672fae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a5e1db-71cb-446f-acd5-f4024046c406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Lock "cinder-0ea56198-00d0-4056-91d1-9fb29a086f6c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a5e1db-71cb-446f-acd5-f4024046c406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249922750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ae2449-b768-4e2b-b8e9-da23f2543d98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='354f8cea615d45f1a59ce3257a7c467a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:00Z,use_quota=True,user_id='ba74b7308d114dbea446cfaf881bcd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589e7cb5-cc9c-4e55-85de-a69d99a472ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589e7cb5-cc9c-4e55-85de-a69d99a472ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6bc04f-6d0e-4fe6-9519-c63e78cfbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6bc04f-6d0e-4fe6-9519-c63e78cfbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ae2449-b768-4e2b-b8e9-da23f2543d98', 'volume_name': 'volume-44ae2449-b768-4e2b-b8e9-da23f2543d98', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f7951-ccf0-45e0-8ab2-9b136bc93dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f7951-ccf0-45e0-8ab2-9b136bc93dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa17b67-382c-44ab-9de6-118d5a78c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Volume 44ae2449-b768-4e2b-b8e9-da23f2543d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ae2449-b768-4e2b-b8e9-da23f2543d98', 'volume_size': 1} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249922750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ae2449-b768-4e2b-b8e9-da23f2543d98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='354f8cea615d45f1a59ce3257a7c467a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:00Z,use_quota=True,user_id='ba74b7308d114dbea446cfaf881bcd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Creating volume 44ae2449-b768-4e2b-b8e9-da23f2543d98 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:00 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:00 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 1073741824 Jul 25 02:47:00 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Acquiring lock "cinder-quobyte-0ea56198-00d0-4056-91d1-9fb29a086f6c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Lock "cinder-quobyte-0ea56198-00d0-4056-91d1-9fb29a086f6c" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d585a6a-3ea2-4e72-a3e9-1d15fd35d774]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:00 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c Jul 25 02:47:00 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:00 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 1073741824" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:00 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c" returned: 0 in 0.383s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:00 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 Jul 25 02:47:00 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:00 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c Jul 25 02:47:00 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:01 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:01 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0ea56198-00d0-4056-91d1-9fb29a086f6c" returned: 0 in 0.245s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa17b67-382c-44ab-9de6-118d5a78c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ae2449-b768-4e2b-b8e9-da23f2543d98', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8450abed-a6d2-4579-bfc5-f26aa5edb6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Lock "cinder-quobyte-0ea56198-00d0-4056-91d1-9fb29a086f6c" released by "delete_volume" :: held 0.701s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Volume volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 (44ae2449-b768-4e2b-b8e9-da23f2543d98): created successfully Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8450abed-a6d2-4579-bfc5-f26aa5edb6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Flow 'volume_create_manager' (efddf8f4-2524-48ec-8caf-fabb5672fae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-768f967a-c98e-4e4d-84cd-5bb332cd5c84 tempest-VolumesListTestJSON-1272813092 None] Created volume successfully. Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Created reservations ['d2f86202-d601-4531-9a44-1468baf283e8', '5015ab52-fb45-4718-921a-7a443e0547f9', 'c217490c-84ae-44ad-8306-b45a0e62b45b', '6a191e75-ebd4-437c-8533-0735fbeb3e26'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:01 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:01 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:01 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.271s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Deleted volume successfully. Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a1ff7fdf-20b9-43f6-83ab-9111808d49d2 tempest-ProjectReaderTests-1704105140 None] Lock "cinder-0ea56198-00d0-4056-91d1-9fb29a086f6c-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Flow 'volume_create_manager' (9774f190-5bf4-4c42-b593-3a135a5029e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3957fd1d-340a-43fa-ba8e-8b584d2041b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3957fd1d-340a-43fa-ba8e-8b584d2041b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-421765473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d1db34-6047-40fc-bbcc-92e3bdb85cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='354f8cea615d45f1a59ce3257a7c467a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:02Z,use_quota=True,user_id='ba74b7308d114dbea446cfaf881bcd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fc1a84-9c65-4bb4-98ca-10a501ea3e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fc1a84-9c65-4bb4-98ca-10a501ea3e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37cb78a-d76e-4bb0-9486-194cd5fbe004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37cb78a-d76e-4bb0-9486-194cd5fbe004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d1db34-6047-40fc-bbcc-92e3bdb85cdb', 'volume_name': 'volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55ec1b8-aa9e-4931-a2e9-f5b2f858f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55ec1b8-aa9e-4931-a2e9-f5b2f858f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8f8cd5-d391-4119-a3dc-10a3fa7ce5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Volume 40d1db34-6047-40fc-bbcc-92e3bdb85cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb', 'volume_size': 1} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-421765473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d1db34-6047-40fc-bbcc-92e3bdb85cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='354f8cea615d45f1a59ce3257a7c467a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:02Z,use_quota=True,user_id='ba74b7308d114dbea446cfaf881bcd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Creating volume 40d1db34-6047-40fc-bbcc-92e3bdb85cdb {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:01 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:02 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb 1073741824 Jul 25 02:47:02 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Flow 'volume_create_manager' (e142720c-efb6-4892-93bd-db82924c19cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3543ab9-bb6d-4489-bcf2-63ee718b7a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3543ab9-bb6d-4489-bcf2-63ee718b7a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547786153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc8dd81-83ea-458c-93a6-c7fdba47b015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79103f6257841bb9f13b2516315ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:02Z,use_quota=True,user_id='092ee6e263254f43b26c848fd7d54cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033ab89c-9e8d-42b3-b3bc-4e7d10810545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033ab89c-9e8d-42b3-b3bc-4e7d10810545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c060cbf-7a63-4f56-ac18-da1344f41f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c060cbf-7a63-4f56-ac18-da1344f41f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc8dd81-83ea-458c-93a6-c7fdba47b015', 'volume_name': 'volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fad31a8-fe54-45ea-8275-fee02ab5e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fad31a8-fe54-45ea-8275-fee02ab5e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2195a3-dcd3-4204-8524-e4cf2ed92429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Volume 4dc8dd81-83ea-458c-93a6-c7fdba47b015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015', 'volume_size': 1} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:02 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb 1073741824" returned: 0 in 0.407s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:02 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb Jul 25 02:47:02 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:02 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547786153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc8dd81-83ea-458c-93a6-c7fdba47b015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79103f6257841bb9f13b2516315ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:02Z,use_quota=True,user_id='092ee6e263254f43b26c848fd7d54cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Creating volume 4dc8dd81-83ea-458c-93a6-c7fdba47b015 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:02 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:02 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 1073741824 Jul 25 02:47:02 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8f8cd5-d391-4119-a3dc-10a3fa7ce5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a225c6b-5a3f-4497-96b9-3d47cace3b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Volume volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb (40d1db34-6047-40fc-bbcc-92e3bdb85cdb): created successfully Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a225c6b-5a3f-4497-96b9-3d47cace3b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Flow 'volume_create_manager' (9774f190-5bf4-4c42-b593-3a135a5029e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:02 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a286f9bb-9977-4837-9d9e-609a508f5ede tempest-VolumesListTestJSON-1272813092 None] Created volume successfully. Jul 25 02:47:03 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 1073741824" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:03 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 Jul 25 02:47:03 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:03 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2195a3-dcd3-4204-8524-e4cf2ed92429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cb2204-83d4-4c51-b0f2-03a152b13731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Volume volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 (4dc8dd81-83ea-458c-93a6-c7fdba47b015): created successfully Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cb2204-83d4-4c51-b0f2-03a152b13731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Flow 'volume_create_manager' (e142720c-efb6-4892-93bd-db82924c19cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7a764b94-472e-4863-8a8b-2a32a7a56731 tempest-ProjectReaderTests-1704105140 None] Created volume successfully. Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Acquiring lock "cinder-4dc8dd81-83ea-458c-93a6-c7fdba47b015-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Lock "cinder-4dc8dd81-83ea-458c-93a6-c7fdba47b015-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Acquiring lock "cinder-quobyte-4dc8dd81-83ea-458c-93a6-c7fdba47b015" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Lock "cinder-quobyte-4dc8dd81-83ea-458c-93a6-c7fdba47b015" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c718a-02b1-45b4-b842-c980de1d4e0b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:04 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 Jul 25 02:47:04 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Flow 'volume_create_manager' (000dc745-dd7b-4f62-acc9-a25fb4ac6d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c749aa3b-3dd9-46e5-8a2c-378813c75f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c749aa3b-3dd9-46e5-8a2c-378813c75f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1826216936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f8f5aa-3592-4931-bd23-66461806bc88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='354f8cea615d45f1a59ce3257a7c467a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:04Z,use_quota=True,user_id='ba74b7308d114dbea446cfaf881bcd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ac8c93-2cea-4343-af56-f5cbe6864f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ac8c93-2cea-4343-af56-f5cbe6864f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab37ff4-c5b1-41ea-be28-8832b5844297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab37ff4-c5b1-41ea-be28-8832b5844297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f8f5aa-3592-4931-bd23-66461806bc88', 'volume_name': 'volume-e6f8f5aa-3592-4931-bd23-66461806bc88', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57554b80-f178-40c3-b911-bb71958a624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:04 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57554b80-f178-40c3-b911-bb71958a624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6067b938-f9a0-4917-9c08-dbdbc7abe53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Volume e6f8f5aa-3592-4931-bd23-66461806bc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f8f5aa-3592-4931-bd23-66461806bc88', 'volume_size': 1} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1826216936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f8f5aa-3592-4931-bd23-66461806bc88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='354f8cea615d45f1a59ce3257a7c467a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:04Z,use_quota=True,user_id='ba74b7308d114dbea446cfaf881bcd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Creating volume e6f8f5aa-3592-4931-bd23-66461806bc88 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:04 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015" returned: 0 in 0.443s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:04 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 1073741824 Jul 25 02:47:04 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:04 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015 Jul 25 02:47:04 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:04 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4dc8dd81-83ea-458c-93a6-c7fdba47b015" returned: 0 in 0.256s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Lock "cinder-quobyte-4dc8dd81-83ea-458c-93a6-c7fdba47b015" released by "delete_volume" :: held 0.742s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Created reservations ['e8fb8a60-3dfa-456f-8cf7-97bd526d5a8f', 'b85ba922-b667-438f-9b37-b6fef54d06ff', '122209a9-05a6-47dd-a797-4701a1b80f71', '301b818a-1305-4a0c-873c-ccc4b07ac60d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:04 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:04 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:04 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 1073741824" returned: 0 in 0.437s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:04 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 Jul 25 02:47:04 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:05 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.256s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Deleted volume successfully. Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30f8b5d0-6d8a-4002-9ce0-b5e21e60f2db tempest-ProjectReaderTests-1704105140 None] Lock "cinder-4dc8dd81-83ea-458c-93a6-c7fdba47b015-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:05 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6067b938-f9a0-4917-9c08-dbdbc7abe53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f8f5aa-3592-4931-bd23-66461806bc88', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c08a780-aca7-4883-9913-9ca4da1eeec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:05 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Volume volume-e6f8f5aa-3592-4931-bd23-66461806bc88 (e6f8f5aa-3592-4931-bd23-66461806bc88): created successfully Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c08a780-aca7-4883-9913-9ca4da1eeec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Flow 'volume_create_manager' (000dc745-dd7b-4f62-acc9-a25fb4ac6d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3c2c6975-f7a1-4d8a-9819-9c4115f6c335 tempest-VolumesListTestJSON-1272813092 None] Created volume successfully. Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "cinder-e6f8f5aa-3592-4931-bd23-66461806bc88-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-e6f8f5aa-3592-4931-bd23-66461806bc88-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "cinder-quobyte-e6f8f5aa-3592-4931-bd23-66461806bc88" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-quobyte-e6f8f5aa-3592-4931-bd23-66461806bc88" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c99653-a2f1-457d-be2e-631ab639ed06]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:07 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 Jul 25 02:47:07 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:07 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:07 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88 Jul 25 02:47:07 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:08 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e6f8f5aa-3592-4931-bd23-66461806bc88" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-quobyte-e6f8f5aa-3592-4931-bd23-66461806bc88" released by "delete_volume" :: held 0.649s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Created reservations ['9e6f30b8-d095-4709-98b0-2d83d0eafddc', '2ec0a871-81e4-4513-a0a9-a656e6ddfa7e', '82440ac1-fbd7-4b0a-8fc3-bbca9d2a7914', 'e83a69c0-08f1-4650-a586-4c228b8ca8f1'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:08 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:08 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:08 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.280s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Deleted volume successfully. Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-67d3a023-3056-4483-8720-2115321adc15 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-e6f8f5aa-3592-4931-bd23-66461806bc88-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "cinder-40d1db34-6047-40fc-bbcc-92e3bdb85cdb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-40d1db34-6047-40fc-bbcc-92e3bdb85cdb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "cinder-quobyte-40d1db34-6047-40fc-bbcc-92e3bdb85cdb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-quobyte-40d1db34-6047-40fc-bbcc-92e3bdb85cdb" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d5528e-3dc3-4956-a663-c7052da78390]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:08 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb Jul 25 02:47:08 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:09 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb" returned: 0 in 0.409s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:09 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb Jul 25 02:47:09 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:09 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-40d1db34-6047-40fc-bbcc-92e3bdb85cdb" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-quobyte-40d1db34-6047-40fc-bbcc-92e3bdb85cdb" released by "delete_volume" :: held 0.723s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Created reservations ['7c54a4ab-1c29-4c39-85dc-43224e402c07', '0e751b23-f65b-4691-aee9-585c15a50884', '1cdd97ae-713e-451b-a492-5dae03167cf6', '97a4e057-7ba5-49e1-a78c-edb835b1e1f5'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:09 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:09 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:09 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Deleted volume successfully. Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e32690ae-3aa2-4c6d-8390-c503e41c10f1 tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-40d1db34-6047-40fc-bbcc-92e3bdb85cdb-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "cinder-44ae2449-b768-4e2b-b8e9-da23f2543d98-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-44ae2449-b768-4e2b-b8e9-da23f2543d98-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "cinder-quobyte-44ae2449-b768-4e2b-b8e9-da23f2543d98" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-quobyte-44ae2449-b768-4e2b-b8e9-da23f2543d98" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f84da5a-cfde-45cc-9f5e-07988ba26b08]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:10 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 Jul 25 02:47:10 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:10 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:10 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98 Jul 25 02:47:10 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:10 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-44ae2449-b768-4e2b-b8e9-da23f2543d98" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-quobyte-44ae2449-b768-4e2b-b8e9-da23f2543d98" released by "delete_volume" :: held 0.673s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Created reservations ['040f2aeb-7a09-47a6-a870-9e81dc057dba', '0c2fe180-3474-48a1-a68f-54c0b75e4000', 'b8b6a929-fdae-46a6-b48f-5bc4532103bc', '147f74f2-17a0-451c-92a9-2a0936ea7ff1'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:10 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:10 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:11 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.297s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:11 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Deleted volume successfully. Jul 25 02:47:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-663ca1e8-58d9-41df-86c2-d9042cfb4bae tempest-VolumesListTestJSON-1272813092 None] Lock "cinder-44ae2449-b768-4e2b-b8e9-da23f2543d98-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:13 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Flow 'volume_create_manager' (6bb7b849-a7bd-4076-b4e2-85a7af20f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38b805e-cdc4-4e64-8480-a381055b7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38b805e-cdc4-4e64-8480-a381055b7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1732738554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007afa87-ccc0-41bc-8a73-245b81cda679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de1346628414f6c91e25700545f1ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:14Z,use_quota=True,user_id='f876af8a2a6d421588e6db90c66983a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7595cfb6-faa0-482f-8252-df1eae015c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7595cfb6-faa0-482f-8252-df1eae015c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72770f8-bd2c-4002-85cb-6560b04aa5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72770f8-bd2c-4002-85cb-6560b04aa5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007afa87-ccc0-41bc-8a73-245b81cda679', 'volume_name': 'volume-007afa87-ccc0-41bc-8a73-245b81cda679', 'volume_size': 2}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1bba99-314a-4901-b42e-d4469c0e4e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1bba99-314a-4901-b42e-d4469c0e4e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a037bd-eef9-47b9-ad02-68470e28ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:14 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Volume 007afa87-ccc0-41bc-8a73-245b81cda679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007afa87-ccc0-41bc-8a73-245b81cda679', 'volume_size': 2} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1732738554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007afa87-ccc0-41bc-8a73-245b81cda679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de1346628414f6c91e25700545f1ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:14Z,use_quota=True,user_id='f876af8a2a6d421588e6db90c66983a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Creating volume 007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:14 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 2147483648 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:14 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 2147483648 Jul 25 02:47:14 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:14 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 2147483648" returned: 0 in 0.476s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:14 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 Jul 25 02:47:14 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:14 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a037bd-eef9-47b9-ad02-68470e28ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007afa87-ccc0-41bc-8a73-245b81cda679', 'volume_size': 2}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f58d4b-e47f-4b07-8dc9-e25058a6f557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:14 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Volume volume-007afa87-ccc0-41bc-8a73-245b81cda679 (007afa87-ccc0-41bc-8a73-245b81cda679): created successfully Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f58d4b-e47f-4b07-8dc9-e25058a6f557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:14 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Flow 'volume_create_manager' (6bb7b849-a7bd-4076-b4e2-85a7af20f96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-167c2a13-721f-4eaa-b75c-2370ea7db776 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Created volume successfully. Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Creating offline snapshot ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 of volume 007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc65ef-053b-4dee-801c-fb14046f5446]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:15 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 Jul 25 02:47:15 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:15 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679" returned: 0 in 0.350s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 2G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:15 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 2G Jul 25 02:47:15 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:15 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 2G" returned: 0 in 0.378s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-007afa87-ccc0-41bc-8a73-245b81cda679 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:15 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-007afa87-ccc0-41bc-8a73-245b81cda679 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 Jul 25 02:47:15 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:16 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-007afa87-ccc0-41bc-8a73-245b81cda679 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" returned: 0 in 0.283s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:16 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 is being set with open permissions: ugo+rw Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:16 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 Jul 25 02:47:16 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:16 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:16 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info Jul 25 02:47:16 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:16 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info" returned: 0 in 0.248s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:16 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info is being set with open permissions: ugo+rw Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:16 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info Jul 25 02:47:16 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:16 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.info" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3d17c85f-415d-406b-b187-a5c4c6a14654 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Create snapshot completed successfully Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "cinder-ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "cinder-quobyte-007afa87-ccc0-41bc-8a73-245b81cda679" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-quobyte-007afa87-ccc0-41bc-8a73-245b81cda679" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "cinder-quobyte-ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-quobyte-ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Deleting offline snapshot ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 of volume 007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] snapshot_file for this snap is: volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[023f369b-4ceb-47da-90f0-a4d9a135847a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:17 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 Jul 25 02:47:17 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:17 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" returned: 0 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-007afa87-ccc0-41bc-8a73-245b81cda679(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa52529-677a-4901-a912-b6baa0eb4230]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:17 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 Jul 25 02:47:17 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:18 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679" returned: 0 in 0.348s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:18 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 Jul 25 02:47:18 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:18 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:18 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1 Jul 25 02:47:18 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:18 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679.ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-quobyte-ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1" released by "_delete_snapshot" :: held 1.401s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-quobyte-007afa87-ccc0-41bc-8a73-245b81cda679" released by "delete_snapshot" :: held 1.430s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Created reservations ['8da25c57-5346-452b-a8d9-53005f99a5ad', '4a84056b-cb8c-4d38-8529-36d02cd8e904', '952a8374-a840-4b15-94ff-bd23a75bedb8', '90f23043-1b45-4e85-8555-ea0b62dc8d7e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Delete snapshot completed successfully. Jul 25 02:47:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c555c1da-64cf-4c44-bc14-0220a48a33d0 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-ee393c9e-e935-45c4-ac5b-c2a13c1b5fd1-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "cinder-007afa87-ccc0-41bc-8a73-245b81cda679-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-007afa87-ccc0-41bc-8a73-245b81cda679-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "cinder-quobyte-007afa87-ccc0-41bc-8a73-245b81cda679" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:47:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-quobyte-007afa87-ccc0-41bc-8a73-245b81cda679" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:47:19 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c6b2a4-5f43-4a5b-9292-0436ed816832]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:47:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:19 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 Jul 25 02:47:19 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:20 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:20 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679 Jul 25 02:47:20 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:20 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-007afa87-ccc0-41bc-8a73-245b81cda679" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-quobyte-007afa87-ccc0-41bc-8a73-245b81cda679" released by "delete_volume" :: held 0.664s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Created reservations ['57e471ba-ab70-4971-ad36-6b7798cb5088', '168223cb-09a6-434b-8072-1fb02f88a4bd', '34ce6675-9ec8-4916-867a-20d355043f4f', '27a119c4-ddc6-449d-9125-0003f6667b82'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:20 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:20 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:20 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Deleted volume successfully. Jul 25 02:47:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-270564d4-e286-49fb-a539-787501893133 tempest-VolumesSnapshotNegativeTestJSON-2071588013 None] Lock "cinder-007afa87-ccc0-41bc-8a73-245b81cda679-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:47:30 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=78,cinder:UPDATE=97,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:47:30 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=106,cinder:SELECT=68,cinder:INSERT=26,cinder:DELETE=9 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:47:40 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Flow 'volume_create_manager' (df7ac4cc-8f5e-4a19-ac07-8200659c6236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8d451a-25e1-43ba-ac08-e0dadcba91f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8d451a-25e1-43ba-ac08-e0dadcba91f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-942423375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401aa1f0-d0ea-4fce-9202-4866f14c184e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75346393d49443a597d4a4c571b88ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:41Z,use_quota=True,user_id='32ecfd6d44014434ba40d73f5914dd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619180cc-b108-446b-9887-d67d3cb4ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619180cc-b108-446b-9887-d67d3cb4ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8304d12-3d79-44f9-938c-b69a4c448e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8304d12-3d79-44f9-938c-b69a4c448e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401aa1f0-d0ea-4fce-9202-4866f14c184e', 'volume_name': 'volume-401aa1f0-d0ea-4fce-9202-4866f14c184e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d2f841-89df-4d32-b69c-5158431ef9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d2f841-89df-4d32-b69c-5158431ef9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a3e0f2-8540-4224-ac4a-3bfb8464a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Volume 401aa1f0-d0ea-4fce-9202-4866f14c184e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401aa1f0-d0ea-4fce-9202-4866f14c184e', 'volume_size': 1} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-942423375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401aa1f0-d0ea-4fce-9202-4866f14c184e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75346393d49443a597d4a4c571b88ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:41Z,use_quota=True,user_id='32ecfd6d44014434ba40d73f5914dd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Creating volume 401aa1f0-d0ea-4fce-9202-4866f14c184e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:41 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:41 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e 1073741824 Jul 25 02:47:41 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Flow 'volume_create_manager' (dae5f71e-f472-473a-b828-cdb91c25a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30ee7d5-8e2f-4b1a-b10e-3338a4c0d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30ee7d5-8e2f-4b1a-b10e-3338a4c0d976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1113388470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75346393d49443a597d4a4c571b88ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:41Z,use_quota=True,user_id='32ecfd6d44014434ba40d73f5914dd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328a1fb9-de46-44e1-ab23-baa90c8e7db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328a1fb9-de46-44e1-ab23-baa90c8e7db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8b5aaf-9fe7-4aaa-bf2c-cd042559e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8b5aaf-9fe7-4aaa-bf2c-cd042559e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2', 'volume_name': 'volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7093ece3-5661-41a2-ab7d-1e05815030a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7093ece3-5661-41a2-ab7d-1e05815030a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf67b0c-b135-47ef-9aa2-947fb974ddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Volume b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2', 'volume_size': 1} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:41 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e 1073741824" returned: 0 in 0.500s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:41 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e Jul 25 02:47:41 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:41 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1113388470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75346393d49443a597d4a4c571b88ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:47:41Z,use_quota=True,user_id='32ecfd6d44014434ba40d73f5914dd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Creating volume b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:47:41 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a3e0f2-8540-4224-ac4a-3bfb8464a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401aa1f0-d0ea-4fce-9202-4866f14c184e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9842a248-0ed6-4d25-8fc7-c366ca41fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:41 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 1073741824 Jul 25 02:47:41 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:41 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Volume volume-401aa1f0-d0ea-4fce-9202-4866f14c184e (401aa1f0-d0ea-4fce-9202-4866f14c184e): created successfully Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9842a248-0ed6-4d25-8fc7-c366ca41fba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Flow 'volume_create_manager' (df7ac4cc-8f5e-4a19-ac07-8200659c6236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-103b1493-bc44-4232-ac52-8acbc4093afc tempest-TestServerVolumeAttachmentScenario-672347832 None] Created volume successfully. Jul 25 02:47:42 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 1073741824" returned: 0 in 0.463s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:42 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 Jul 25 02:47:42 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:42 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf67b0c-b135-47ef-9aa2-947fb974ddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ad9917-31f9-499e-8fad-d05e22442947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:47:42 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Volume volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 (b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2): created successfully Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ad9917-31f9-499e-8fad-d05e22442947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:47:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Flow 'volume_create_manager' (dae5f71e-f472-473a-b828-cdb91c25a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:47:42 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e406adda-d269-4bd7-a6b8-e748e9c8ce5e tempest-TestServerVolumeAttachmentScenario-672347832 None] Created volume successfully. Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:47:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:47:50 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:47:50 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:47:51 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 25 02:47:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:47:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:47:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:47:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:47:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:47:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:47:52 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:48:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-65ae22de-a6aa-4bff-b434-dd59c9207989 req-23444c64-fde6-4dc6-bb1f-b09b0db180ae tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-65ae22de-a6aa-4bff-b434-dd59c9207989 req-23444c64-fde6-4dc6-bb1f-b09b0db180ae tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-65ae22de-a6aa-4bff-b434-dd59c9207989 req-23444c64-fde6-4dc6-bb1f-b09b0db180ae tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-65ae22de-a6aa-4bff-b434-dd59c9207989 req-23444c64-fde6-4dc6-bb1f-b09b0db180ae tempest-TestServerVolumeAttachmentScenario-672347832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-401aa1f0-d0ea-4fce-9202-4866f14c184e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6597a1da-7e23-41a5-839c-0d3b296fe706', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:48:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-65ae22de-a6aa-4bff-b434-dd59c9207989 req-23444c64-fde6-4dc6-bb1f-b09b0db180ae tempest-TestServerVolumeAttachmentScenario-672347832 None] attachment_update completed successfully. Jul 25 02:48:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-30fea0ee-ce79-4a23-9999-a30e30acbf5b req-3dd1247f-d930-42fc-8997-de1a786ad3f1 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-30fea0ee-ce79-4a23-9999-a30e30acbf5b req-3dd1247f-d930-42fc-8997-de1a786ad3f1 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-30fea0ee-ce79-4a23-9999-a30e30acbf5b req-3dd1247f-d930-42fc-8997-de1a786ad3f1 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-30fea0ee-ce79-4a23-9999-a30e30acbf5b req-3dd1247f-d930-42fc-8997-de1a786ad3f1 tempest-TestServerVolumeAttachmentScenario-672347832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98efbbd7-cdbb-43d1-af11-05ba68991430', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:48:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-30fea0ee-ce79-4a23-9999-a30e30acbf5b req-3dd1247f-d930-42fc-8997-de1a786ad3f1 tempest-TestServerVolumeAttachmentScenario-672347832 None] attachment_update completed successfully. Jul 25 02:48:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-44ce6b52-fe42-44e8-b0af-a9c520a45d6d req-7b7fd04f-acf1-4ecd-8917-44342f4a7678 tempest-TestServerVolumeAttachmentScenario-672347832 None] Terminate volume connection completed successfully. Jul 25 02:48:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-44ce6b52-fe42-44e8-b0af-a9c520a45d6d req-7b7fd04f-acf1-4ecd-8917-44342f4a7678 tempest-TestServerVolumeAttachmentScenario-672347832 None] Deleting attachment 98efbbd7-cdbb-43d1-af11-05ba68991430. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:48:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-e49788da-38ed-4f24-a765-4405fb909ffb req-1256173c-a5b3-4f80-936e-5a3a408acb0c tempest-TestServerVolumeAttachmentScenario-672347832 None] Terminate volume connection completed successfully. Jul 25 02:48:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-e49788da-38ed-4f24-a765-4405fb909ffb req-1256173c-a5b3-4f80-936e-5a3a408acb0c tempest-TestServerVolumeAttachmentScenario-672347832 None] Deleting attachment 6597a1da-7e23-41a5-839c-0d3b296fe706. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:48:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "cinder-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:48:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:48:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "cinder-quobyte-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:48:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-quobyte-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:48:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb58c57-61e9-417b-be70-ef033f68f0fc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:48:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:25 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 Jul 25 02:48:25 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:25 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:25 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2 Jul 25 02:48:25 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:25 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-quobyte-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2" released by "delete_volume" :: held 0.645s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Created reservations ['e63b8a68-8aec-449a-9789-1fe6835d3882', '5ebcf65d-6d0b-49da-9632-76f49319b2f5', '1647a048-6d8f-47e1-a34b-f4dc627e4679', '90941d3a-44db-4b50-854e-15d67796b2df'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:25 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:48:25 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:25 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:48:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Deleted volume successfully. Jul 25 02:48:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6c3714bb-0554-4957-8b43-c38d6f0de6c7 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-b6e33ba4-1bf0-4765-b1d6-9f44a8b46be2-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "cinder-401aa1f0-d0ea-4fce-9202-4866f14c184e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-401aa1f0-d0ea-4fce-9202-4866f14c184e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "cinder-quobyte-401aa1f0-d0ea-4fce-9202-4866f14c184e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-quobyte-401aa1f0-d0ea-4fce-9202-4866f14c184e" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2aeba1-bbe0-43f5-a74e-af06fa0b1ebb]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:26 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e Jul 25 02:48:26 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:26 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:26 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e Jul 25 02:48:26 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:26 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-401aa1f0-d0ea-4fce-9202-4866f14c184e" returned: 0 in 0.241s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-quobyte-401aa1f0-d0ea-4fce-9202-4866f14c184e" released by "delete_volume" :: held 0.637s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Created reservations ['5e3da999-dcf8-44dc-9ad0-bd501f4381f1', '833d2955-7885-4a65-af49-bf5a70d319d9', '4194f94d-a0aa-4879-ac1d-29457bd39402', '6757a648-e6ea-49d7-837d-7e7509394cb7'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:26 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:48:26 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:27 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.239s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:27 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:48:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Deleted volume successfully. Jul 25 02:48:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e2355372-327b-497f-a216-4471bab5d8a9 tempest-TestServerVolumeAttachmentScenario-672347832 None] Lock "cinder-401aa1f0-d0ea-4fce-9202-4866f14c184e-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:48:36 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:48:37 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=26,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:50 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:48:50 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:51 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:48:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:48:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:48:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Flow 'volume_create_manager' (7a5da08f-3e15-47a9-8749-44861a474d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf5d6ac-d46c-47c8-8538-0a92d856654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf5d6ac-d46c-47c8-8538-0a92d856654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1340731392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30361c83-3fe9-40fc-a272-db9bb49a7439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cae69837edb4756970f4a821fafa600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:48:57Z,use_quota=True,user_id='e082845ae6ce426eafac5065a15fd2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dc35b9-749f-480f-82f8-40a11d0267d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dc35b9-749f-480f-82f8-40a11d0267d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742869ff-056b-4413-b756-cb208f7a8d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:48:56 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742869ff-056b-4413-b756-cb208f7a8d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30361c83-3fe9-40fc-a272-db9bb49a7439', 'volume_name': 'volume-30361c83-3fe9-40fc-a272-db9bb49a7439', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf39aa7-036f-4d67-a259-9dd7b1c3d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf39aa7-036f-4d67-a259-9dd7b1c3d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89787a85-c49d-4bc2-9cf2-f4cec05868f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:48:57 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Volume 30361c83-3fe9-40fc-a272-db9bb49a7439: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30361c83-3fe9-40fc-a272-db9bb49a7439', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Trying to clone 30361c83-3fe9-40fc-a272-db9bb49a7439 from image 19c99a4c-891e-4766-a74f-7e24d755618e at location (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:48:57 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Image download 20.69 MB at 20.69 MB/s Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca85dcc1-96c3-4431-a320-6a59ae10529c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:48:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:57 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD Jul 25 02:48:57 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:58 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e is fetched for user e082845ae6ce426eafac5065a15fd2f8. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c1fe51-556c-47c5-81e6-6f5f8e6b5bed]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:58 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD Jul 25 02:48:58 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:58 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1340731392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30361c83-3fe9-40fc-a272-db9bb49a7439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cae69837edb4756970f4a821fafa600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:48:57Z,use_quota=True,user_id='e082845ae6ce426eafac5065a15fd2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Creating volume 30361c83-3fe9-40fc-a272-db9bb49a7439 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:48:58 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:58 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 1073741824 Jul 25 02:48:58 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:58 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 1073741824" returned: 0 in 0.413s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:58 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 Jul 25 02:48:58 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:59 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439" returned: 0 in 0.245s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Attempting download of 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume 30361c83-3fe9-40fc-a272-db9bb49a7439. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb9f99f-6069-43c0-9e58-e6c234863ecd]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:59 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb Jul 25 02:48:59 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:59 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb" returned: 0 in 0.336s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:59 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb Jul 25 02:48:59 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:48:59 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb" returned: 1 in 0.314s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19c99a4c-891e-4766-a74f-7e24d755618e_ev4awutb' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9244451b-2902-4832-a96d-791a5f60948c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:48:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:48:59 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD Jul 25 02:48:59 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:49:00 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 25 02:49:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:49:00 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] 19c99a4c-891e-4766-a74f-7e24d755618e was qcow2, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:49:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:49:00 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 Jul 25 02:49:00 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:49:01 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 25 02:49:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439" returned: 0 in 1.641s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:49:01 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19c99a4c-891e-4766-a74f-7e24d755618e_nwjf04fzdevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:49:01 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Converted 112.00 MB image at 68.19 MB/s Jul 25 02:49:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:49:01 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 1G Jul 25 02:49:01 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:49:02 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 1G" returned: 0 in 0.325s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Downloaded image 19c99a4c-891e-4766-a74f-7e24d755618e ((None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}])) to volume 30361c83-3fe9-40fc-a272-db9bb49a7439 successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Temporary image 19c99a4c-891e-4766-a74f-7e24d755618e for user e082845ae6ce426eafac5065a15fd2f8 is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Marking volume 30361c83-3fe9-40fc-a272-db9bb49a7439 as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Copying metadata from image 19c99a4c-891e-4766-a74f-7e24d755618e to 30361c83-3fe9-40fc-a272-db9bb49a7439. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Creating volume glance metadata for volume 30361c83-3fe9-40fc-a272-db9bb49a7439 backed by image 19c99a4c-891e-4766-a74f-7e24d755618e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89787a85-c49d-4bc2-9cf2-f4cec05868f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30361c83-3fe9-40fc-a272-db9bb49a7439', 'volume_size': 1, 'image_id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19c99a4c-891e-4766-a74f-7e24d755618e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84c9381de4f3449096ac7d42c577dfcf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19c99a4c-891e-4766-a74f-7e24d755618e', 'created_at': datetime.datetime(2026, 7, 25, 0, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19c99a4c-891e-4766-a74f-7e24d755618e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5141b3-4af7-4551-97b1-22e8697e2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:49:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Volume volume-30361c83-3fe9-40fc-a272-db9bb49a7439 (30361c83-3fe9-40fc-a272-db9bb49a7439): created successfully Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5141b3-4af7-4551-97b1-22e8697e2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:49:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Flow 'volume_create_manager' (7a5da08f-3e15-47a9-8749-44861a474d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:49:02 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c07b6715-65a4-4754-aa12-3ee2948358d4 tempest-TestShelveInstance-965735403 None] Created volume successfully. Jul 25 02:49:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-96a3fbad-69f2-4afb-a26f-e321917d492f req-b66ab2ca-6b0f-45af-840a-336e9eec9c02 tempest-TestShelveInstance-965735403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:49:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-96a3fbad-69f2-4afb-a26f-e321917d492f req-b66ab2ca-6b0f-45af-840a-336e9eec9c02 tempest-TestShelveInstance-965735403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:49:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-96a3fbad-69f2-4afb-a26f-e321917d492f req-b66ab2ca-6b0f-45af-840a-336e9eec9c02 tempest-TestShelveInstance-965735403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:49:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-96a3fbad-69f2-4afb-a26f-e321917d492f req-b66ab2ca-6b0f-45af-840a-336e9eec9c02 tempest-TestShelveInstance-965735403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-30361c83-3fe9-40fc-a272-db9bb49a7439', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87048569-0bcc-46a3-974f-5ab9f49e8749', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:49:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-96a3fbad-69f2-4afb-a26f-e321917d492f req-b66ab2ca-6b0f-45af-840a-336e9eec9c02 tempest-TestShelveInstance-965735403 None] attachment_update completed successfully. Jul 25 02:49:15 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=6,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:49:15 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=6 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:49:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-615e2114-4d7c-421d-a13c-f79fa537703f req-e35fd316-11d0-4b36-b9bd-cc540109b9ba tempest-TestShelveInstance-965735403 None] Terminate volume connection completed successfully. Jul 25 02:49:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-615e2114-4d7c-421d-a13c-f79fa537703f req-e35fd316-11d0-4b36-b9bd-cc540109b9ba tempest-TestShelveInstance-965735403 None] Deleting attachment 87048569-0bcc-46a3-974f-5ab9f49e8749. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:49:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c5ba9bee-8f78-4b5a-89a6-b476283b0a92 req-6b751c04-b576-4852-b4ee-b61f238603ae tempest-TestShelveInstance-965735403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:49:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c5ba9bee-8f78-4b5a-89a6-b476283b0a92 req-6b751c04-b576-4852-b4ee-b61f238603ae tempest-TestShelveInstance-965735403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:49:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-c5ba9bee-8f78-4b5a-89a6-b476283b0a92 req-6b751c04-b576-4852-b4ee-b61f238603ae tempest-TestShelveInstance-965735403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:49:37 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-c5ba9bee-8f78-4b5a-89a6-b476283b0a92 req-6b751c04-b576-4852-b4ee-b61f238603ae tempest-TestShelveInstance-965735403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac', 'name': 'volume-30361c83-3fe9-40fc-a272-db9bb49a7439', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ac1c1f2-8a54-48bf-ae49-e9954323d21b', 'enforce_multipath': True} {{(pid=88279) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 25 02:49:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-c5ba9bee-8f78-4b5a-89a6-b476283b0a92 req-6b751c04-b576-4852-b4ee-b61f238603ae tempest-TestShelveInstance-965735403 None] attachment_update completed successfully. Jul 25 02:49:48 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:49:48 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:49:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:49:50 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:49:50 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:49:51 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 25 02:49:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:49:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:49:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:49:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:49:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:50:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-31f29423-c0a2-40e3-9e4c-315cca828811 tempest-TestShelveInstance-965735403 None] Terminate volume connection completed successfully. Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-31f29423-c0a2-40e3-9e4c-315cca828811 tempest-TestShelveInstance-965735403 None] Deleting attachment 3ac1c1f2-8a54-48bf-ae49-e9954323d21b. {{(pid=88279) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Acquiring lock "cinder-30361c83-3fe9-40fc-a272-db9bb49a7439-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Lock "cinder-30361c83-3fe9-40fc-a272-db9bb49a7439-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Acquiring lock "cinder-quobyte-30361c83-3fe9-40fc-a272-db9bb49a7439" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Lock "cinder-quobyte-30361c83-3fe9-40fc-a272-db9bb49a7439" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d9262e-dc18-4217-8aff-66a275060fdd]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:09 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 Jul 25 02:50:09 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:09 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:09 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439 Jul 25 02:50:09 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:09 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-30361c83-3fe9-40fc-a272-db9bb49a7439" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Lock "cinder-quobyte-30361c83-3fe9-40fc-a272-db9bb49a7439" released by "delete_volume" :: held 0.694s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG cinder.quota [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Created reservations ['6386bc02-21e5-41e9-8894-ccfd664104e6', '7b857c7a-31e5-4152-9aef-aad37d5c2781', 'b468b4c6-e1dd-4912-9ee6-30405bfdb4b1', 'd680f01c-3076-4d3f-8cd4-3fa6f1b2970f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:09 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:50:09 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:10 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.268s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:10 devstack cinder-volume[88279]: DEBUG cinder.manager [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:50:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Deleted volume successfully. Jul 25 02:50:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [req-05b0f391-9826-475b-9d0b-99bc90631ca0 req-810ef850-07a6-41bc-bc06-a495ae98668b tempest-TestShelveInstance-965735403 None] Lock "cinder-30361c83-3fe9-40fc-a272-db9bb49a7439-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Flow 'volume_create_manager' (42f63863-aa4e-4475-be9f-8c6684c2dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a132b62-e309-495b-ae10-da0fe8478c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a132b62-e309-495b-ae10-da0fe8478c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-489175685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab970508-c6a3-43b8-bf02-23a8e858cdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bddfa7e5d2a494aaf0fffb510a47d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:20Z,use_quota=True,user_id='06d93ae713a24b22a9a8e633fdeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6950f07e-b44b-4bf3-8484-d5cdc7e83202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6950f07e-b44b-4bf3-8484-d5cdc7e83202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f6c09b-d7ff-483c-bfde-1edbce98eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f6c09b-d7ff-483c-bfde-1edbce98eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab970508-c6a3-43b8-bf02-23a8e858cdaa', 'volume_name': 'volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481156a5-c22d-453a-a004-657a29f04bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481156a5-c22d-453a-a004-657a29f04bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa01967-a34f-45e8-8343-da508c1c255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Volume ab970508-c6a3-43b8-bf02-23a8e858cdaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa', 'volume_size': 1} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-489175685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab970508-c6a3-43b8-bf02-23a8e858cdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bddfa7e5d2a494aaf0fffb510a47d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:20Z,use_quota=True,user_id='06d93ae713a24b22a9a8e633fdeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Creating volume ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:50:20 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:20 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa 1073741824 Jul 25 02:50:20 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:20 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa 1073741824" returned: 0 in 0.410s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:20 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:20 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.237s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa01967-a34f-45e8-8343-da508c1c255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b997f01e-7814-4c60-867a-324810d63168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Volume volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa (ab970508-c6a3-43b8-bf02-23a8e858cdaa): created successfully Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b997f01e-7814-4c60-867a-324810d63168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Flow 'volume_create_manager' (42f63863-aa4e-4475-be9f-8c6684c2dc47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bf67b2f5-f1cb-4077-8f99-f414c045e5a2 tempest-VolumeDependencyTests-1766622955 None] Created volume successfully. Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Creating offline snapshot 4291378a-f09c-4672-adf0-57de4a368f0d of volume ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f152a77-1eb1-48e0-8d8e-6b37faf3701e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:21 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:21 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:21 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.351s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:21 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d 1G Jul 25 02:50:21 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:21 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d 1G" returned: 0 in 0.384s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:21 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d Jul 25 02:50:21 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:22 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:22 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d is being set with open permissions: ugo+rw Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:22 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d Jul 25 02:50:22 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:22 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d" returned: 0 in 0.231s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:22 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info Jul 25 02:50:22 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:22 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info" returned: 0 in 0.252s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:22 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info is being set with open permissions: ugo+rw Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:22 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info Jul 25 02:50:22 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:22 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.info" returned: 0 in 0.250s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d3a50f89-94a9-43be-830e-fefe1bfe4c41 tempest-VolumeDependencyTests-1766622955 None] Create snapshot completed successfully Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Flow 'volume_create_manager' (1844fe5a-c83e-46fd-8b57-5961a042fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11da3fe7-da29-43c2-ac99-cba8d030784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11da3fe7-da29-43c2-ac99-cba8d030784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1439889914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c616d3-5926-4347-b0ab-49e3b4ffd3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bddfa7e5d2a494aaf0fffb510a47d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4291378a-f09c-4672-adf0-57de4a368f0d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:24Z,use_quota=True,user_id='06d93ae713a24b22a9a8e633fdeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3725d763-0fa4-4684-a7fa-dfb35e28e159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3725d763-0fa4-4684-a7fa-dfb35e28e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ba0037-3a41-41e7-ae1e-e451042831ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ba0037-3a41-41e7-ae1e-e451042831ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4c616d3-5926-4347-b0ab-49e3b4ffd3fb', 'volume_name': 'volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb', 'volume_size': 1, 'snapshot_id': '4291378a-f09c-4672-adf0-57de4a368f0d'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395040ad-ca29-4f68-8222-11dad0194e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395040ad-ca29-4f68-8222-11dad0194e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37652e04-1d51-4781-b858-a20a33220e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:23 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Volume d4c616d3-5926-4347-b0ab-49e3b4ffd3fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb', 'volume_size': 1, 'snapshot_id': '4291378a-f09c-4672-adf0-57de4a368f0d'} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-quobyte-4291378a-f09c-4672-adf0-57de4a368f0d-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-4291378a-f09c-4672-adf0-57de4a368f0d-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Creating volume d4c616d3-5926-4347-b0ab-49e3b4ffd3fb from snapshot 4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-quobyte-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] snapshot: 4291378a-f09c-4672-adf0-57de4a368f0d, volume: d4c616d3-5926-4347-b0ab-49e3b4ffd3fb, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c821e14-1919-4a86-aef0-542156da9c7b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:23 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d Jul 25 02:50:23 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:24 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d" returned: 0 in 0.358s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1466d17a-c0d9-4ba2-bffb-0b02e6c25658]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:24 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:24 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:24 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.361s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:50:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:24 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb Jul 25 02:50:24 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:28 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" returned: 0 in 3.941s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:28 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473bae9-c5e0-4874-860e-22d3cce76208]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:28 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:28 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:29 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.530s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:50:29 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Converted 1024.00 MB image at 259.74 MB/s Jul 25 02:50:29 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb is being set with open permissions: ugo+rw Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:29 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb Jul 25 02:50:29 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:29 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" returned: 0 in 0.239s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" released by "_copy_volume_from_snapshot" :: held 5.516s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-4291378a-f09c-4672-adf0-57de4a368f0d-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" released by "_create_volume_from_snapshot" :: held 5.543s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.558s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37652e04-1d51-4781-b858-a20a33220e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb', 'volume_size': 1, 'snapshot_id': '4291378a-f09c-4672-adf0-57de4a368f0d'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf64b50-cae4-45a5-9bbd-b6bef17aaa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Volume volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb (d4c616d3-5926-4347-b0ab-49e3b4ffd3fb): created successfully Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf64b50-cae4-45a5-9bbd-b6bef17aaa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Flow 'volume_create_manager' (1844fe5a-c83e-46fd-8b57-5961a042fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8d3703dd-395d-412e-8621-b27bbef10b8e tempest-VolumeDependencyTests-1766622955 None] Created volume successfully. Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-4291378a-f09c-4672-adf0-57de4a368f0d-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-4291378a-f09c-4672-adf0-57de4a368f0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-quobyte-ab970508-c6a3-43b8-bf02-23a8e858cdaa" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-ab970508-c6a3-43b8-bf02-23a8e858cdaa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-quobyte-4291378a-f09c-4672-adf0-57de4a368f0d" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-4291378a-f09c-4672-adf0-57de4a368f0d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Deleting offline snapshot 4291378a-f09c-4672-adf0-57de4a368f0d of volume ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] snapshot_file for this snap is: volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e35e58-e8a4-4c44-8e62-7869e0ab0098]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:30 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d Jul 25 02:50:30 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:30 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd5ede1-b1bb-4053-ac0e-4789f07026ec]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:30 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:30 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:31 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.350s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:31 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d Jul 25 02:50:31 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:31 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d" returned: 0 in 0.340s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:31 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d Jul 25 02:50:31 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:31 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa.4291378a-f09c-4672-adf0-57de4a368f0d" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-4291378a-f09c-4672-adf0-57de4a368f0d" released by "_delete_snapshot" :: held 1.392s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-ab970508-c6a3-43b8-bf02-23a8e858cdaa" released by "delete_snapshot" :: held 1.418s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Created reservations ['1a5f3007-c09e-4261-871f-7f299451356d', '86c08652-827b-4d2a-9050-fdef5c2dfa10', '3d54de6f-3cd7-451e-8aad-3244f932c58d', '44eb96bf-f76f-47d8-9c01-c79858860dfc'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:50:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Delete snapshot completed successfully. Jul 25 02:50:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3e30c98d-1992-452d-99a1-5e244bfe2f61 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-4291378a-f09c-4672-adf0-57de4a368f0d-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-ab970508-c6a3-43b8-bf02-23a8e858cdaa-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-ab970508-c6a3-43b8-bf02-23a8e858cdaa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-quobyte-ab970508-c6a3-43b8-bf02-23a8e858cdaa" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-ab970508-c6a3-43b8-bf02-23a8e858cdaa" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7d39e-b6d9-4472-981b-9f92248ffe1f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:32 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:32 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:32 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:32 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa Jul 25 02:50:32 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:33 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab970508-c6a3-43b8-bf02-23a8e858cdaa" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-ab970508-c6a3-43b8-bf02-23a8e858cdaa" released by "delete_volume" :: held 0.659s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Created reservations ['5c8dbfe7-e963-4381-9c28-f3fc735dca31', '60bdb696-1240-4f18-b444-ca64c1d6cc82', '6561a5b1-6f1c-41bb-9b3d-b39955804b9d', 'd16a6aec-e650-4a2d-9846-9bf079beb04d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:33 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:50:33 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:33 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.233s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:50:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Deleted volume successfully. Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2424133f-1c49-430e-988d-388c61dfa07f tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-ab970508-c6a3-43b8-bf02-23a8e858cdaa-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "cinder-quobyte-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fafe13-0439-44f8-a6cb-e53e8cd371a0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:33 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb Jul 25 02:50:33 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:33 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" returned: 0 in 0.352s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:33 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb Jul 25 02:50:33 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:34 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" returned: 0 in 0.245s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-quobyte-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb" released by "delete_volume" :: held 0.635s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Created reservations ['5b8b7492-bab2-4d8f-a156-4cd40c589063', '1ca2cff0-37a6-42e2-b41b-3d469f1434ea', '9e44839c-29f7-4718-b093-845a6e9cb247', '3be2eda2-5b60-411e-affd-a45e5debf1de'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:34 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:50:34 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:34 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.237s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:50:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Deleted volume successfully. Jul 25 02:50:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ba5ebf5-a8af-40ee-a5ae-da0507fe7091 tempest-VolumeDependencyTests-1766622955 None] Lock "cinder-d4c616d3-5926-4347-b0ab-49e3b4ffd3fb-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Flow 'volume_create_manager' (acb95db9-a655-41e6-a715-66d59ba54d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d43d5b8-8c2d-4036-be67-4f82ea3f9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d43d5b8-8c2d-4036-be67-4f82ea3f9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191f882c-4e61-444b-845d-fed97644ecc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2a30f36d2446f9b4ffd475a56bbec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:40Z,use_quota=True,user_id='071982e1c34d4aa9932b36a039f366ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239f561-1665-4e95-8c7b-d38a1a3e3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239f561-1665-4e95-8c7b-d38a1a3e3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd7bcd7-9ee8-4177-9e24-ef187852b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd7bcd7-9ee8-4177-9e24-ef187852b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '191f882c-4e61-444b-845d-fed97644ecc2', 'volume_name': 'volume-191f882c-4e61-444b-845d-fed97644ecc2', 'volume_size': 1, 'image_id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '833d14f28807b641fa12da4b2eae4878', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac2a30f36d2446f9b4ffd475a56bbec0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e23c02ae24c9c3c28ae864ee87e758c2c77c37daabd67ec46d94604acb7f5a7f8dcdfad25ee93624fe4c488db07224c90dbe0c232ef94edae20cd5b34106b423', 'id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'created_at': datetime.datetime(2026, 7, 25, 0, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec/file', 'properties': {}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55deb18b-8f96-4e37-a765-2ba628a79f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55deb18b-8f96-4e37-a765-2ba628a79f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2b22d5-79ec-4bb1-b297-39e68a9e5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:40 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Volume 191f882c-4e61-444b-845d-fed97644ecc2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-191f882c-4e61-444b-845d-fed97644ecc2', 'volume_size': 1, 'image_id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '833d14f28807b641fa12da4b2eae4878', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac2a30f36d2446f9b4ffd475a56bbec0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e23c02ae24c9c3c28ae864ee87e758c2c77c37daabd67ec46d94604acb7f5a7f8dcdfad25ee93624fe4c488db07224c90dbe0c232ef94edae20cd5b34106b423', 'id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'created_at': datetime.datetime(2026, 7, 25, 0, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec/file', 'properties': {}}, 'image_service': } Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Trying to clone 191f882c-4e61-444b-845d-fed97644ecc2 from image 4b5dd3cb-207f-4171-8396-d9f7dba31dec at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:50:40 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Image download 0.00 MB at 0.00 MB/s Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866c095-b49b-4236-84d1-e4883be44a26]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:40 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD Jul 25 02:50:40 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:40 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:40 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD Jul 25 02:50:40 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:40 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Temporary image 4b5dd3cb-207f-4171-8396-d9f7dba31dec is fetched for user 071982e1c34d4aa9932b36a039f366ef. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad59140-84db-4a56-bc36-5e202cd08342]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:40 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD Jul 25 02:50:40 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:41 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:41 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD Jul 25 02:50:41 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:41 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD" returned: 1 in 0.322s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191f882c-4e61-444b-845d-fed97644ecc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2a30f36d2446f9b4ffd475a56bbec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:40Z,use_quota=True,user_id='071982e1c34d4aa9932b36a039f366ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Creating volume 191f882c-4e61-444b-845d-fed97644ecc2 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:50:41 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:41 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 1073741824 Jul 25 02:50:41 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:41 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 1073741824" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:41 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 Jul 25 02:50:41 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:42 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Attempting download of 4b5dd3cb-207f-4171-8396-d9f7dba31dec ((None, [{'url': 'file:///opt/stack/data/glance/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'metadata': {}}])) to volume 191f882c-4e61-444b-845d-fed97644ecc2. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509d8d6-75aa-4ad4-85cb-ebced6915d08]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:42 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk Jul 25 02:50:42 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:42 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk" returned: 0 in 0.315s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:42 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk Jul 25 02:50:42 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:42 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk" returned: 1 in 0.321s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5dd3cb-207f-4171-8396-d9f7dba31dec_ulh48wzk' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9a3a4-1269-4385-b526-a213fc46847a]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:43 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD Jul 25 02:50:43 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:43 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:43 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD Jul 25 02:50:43 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:43 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:50:43 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] 4b5dd3cb-207f-4171-8396-d9f7dba31dec was raw, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:50:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:43 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 Jul 25 02:50:43 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:44 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2" returned: 0 in 0.426s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b5dd3cb-207f-4171-8396-d9f7dba31dec_yb1nqs96devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:50:44 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Converted 0.00 MB image at 0.00 MB/s Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:44 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 1G Jul 25 02:50:44 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:44 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 1G" returned: 0 in 0.307s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Downloaded image 4b5dd3cb-207f-4171-8396-d9f7dba31dec ((None, [{'url': 'file:///opt/stack/data/glance/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'metadata': {}}])) to volume 191f882c-4e61-444b-845d-fed97644ecc2 successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Temporary image 4b5dd3cb-207f-4171-8396-d9f7dba31dec for user 071982e1c34d4aa9932b36a039f366ef is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Marking volume 191f882c-4e61-444b-845d-fed97644ecc2 as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Copying metadata from image 4b5dd3cb-207f-4171-8396-d9f7dba31dec to 191f882c-4e61-444b-845d-fed97644ecc2. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Creating volume glance metadata for volume 191f882c-4e61-444b-845d-fed97644ecc2 backed by image 4b5dd3cb-207f-4171-8396-d9f7dba31dec with: {'image_id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '833d14f28807b641fa12da4b2eae4878', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2b22d5-79ec-4bb1-b297-39e68a9e5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191f882c-4e61-444b-845d-fed97644ecc2', 'volume_size': 1, 'image_id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '833d14f28807b641fa12da4b2eae4878', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac2a30f36d2446f9b4ffd475a56bbec0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e23c02ae24c9c3c28ae864ee87e758c2c77c37daabd67ec46d94604acb7f5a7f8dcdfad25ee93624fe4c488db07224c90dbe0c232ef94edae20cd5b34106b423', 'id': '4b5dd3cb-207f-4171-8396-d9f7dba31dec', 'created_at': datetime.datetime(2026, 7, 25, 0, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b5dd3cb-207f-4171-8396-d9f7dba31dec/file', 'properties': {}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bb8650-d5de-40a1-af7b-a8ceefae7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Volume volume-191f882c-4e61-444b-845d-fed97644ecc2 (191f882c-4e61-444b-845d-fed97644ecc2): created successfully Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bb8650-d5de-40a1-af7b-a8ceefae7abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Flow 'volume_create_manager' (acb95db9-a655-41e6-a715-66d59ba54d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-10c138e0-947f-4c1a-8afe-99dba111d265 tempest-VolumeImageDependencyTests-16331401 None] Created volume successfully. Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Acquiring lock "cinder-191f882c-4e61-444b-845d-fed97644ecc2-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Lock "cinder-191f882c-4e61-444b-845d-fed97644ecc2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Acquiring lock "cinder-quobyte-191f882c-4e61-444b-845d-fed97644ecc2" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Lock "cinder-quobyte-191f882c-4e61-444b-845d-fed97644ecc2" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b963ea-777e-46de-a6ae-d902cda41e4c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:45 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 Jul 25 02:50:45 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:45 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2" returned: 0 in 0.360s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:45 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2 Jul 25 02:50:45 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:45 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-191f882c-4e61-444b-845d-fed97644ecc2" returned: 0 in 0.243s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Lock "cinder-quobyte-191f882c-4e61-444b-845d-fed97644ecc2" released by "delete_volume" :: held 0.641s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Created reservations ['8f40c011-60ec-4e10-b6d3-7c5478e329e1', '7a0ea7fe-2166-4c28-9250-57f85c02884a', 'a50657a8-3b87-4427-81e7-193e2db28e7a', '38f8e73b-7c43-471a-abe1-0afde98e6910'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:45 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:50:45 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:46 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:46 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:50:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Deleted volume successfully. Jul 25 02:50:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-27aa4b44-d28c-4d2a-9143-f2027175357c tempest-VolumeImageDependencyTests-16331401 None] Lock "cinder-191f882c-4e61-444b-845d-fed97644ecc2-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:50 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:50:50 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:51 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.264s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:50:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:50:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:50:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:50:55 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=33,cinder:UPDATE=41,cinder:INSERT=13,cinder:DELETE=2 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:50:56 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=47,cinder:INSERT=17,cinder:UPDATE=49,cinder:DELETE=6 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (bc5e456e-3934-45fb-9040-397524232f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04e1a5e-0ff2-4283-9076-94597d72f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04e1a5e-0ff2-4283-9076-94597d72f70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1212313684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ba408-f146-4df2-ad99-0e44ef40a6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:58Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdc8e7e-9855-4653-8890-3c6a49aa43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdc8e7e-9855-4653-8890-3c6a49aa43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5567c92f-f41d-463e-9384-af8cb973a173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5567c92f-f41d-463e-9384-af8cb973a173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2ba408-f146-4df2-ad99-0e44ef40a6ea', 'volume_name': 'volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a986df6e-c321-4fb4-9f4d-4861da958321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a986df6e-c321-4fb4-9f4d-4861da958321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac38850-13af-4a78-88ff-29e84dd4769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Volume fb2ba408-f146-4df2-ad99-0e44ef40a6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea', 'volume_size': 1} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1212313684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ba408-f146-4df2-ad99-0e44ef40a6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:58Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Creating volume fb2ba408-f146-4df2-ad99-0e44ef40a6ea {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:50:58 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:58 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea 1073741824 Jul 25 02:50:58 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (872147d8-e553-4585-a137-c82aa58fc941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e273f52-321f-4b7f-8670-77336f27ea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e273f52-321f-4b7f-8670-77336f27ea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273694011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac473fac-1e21-4d1c-97b2-a56112fb6a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:58Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514b9236-727a-4399-9987-d24a42330a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514b9236-727a-4399-9987-d24a42330a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fc573-1d70-4cb2-8fa8-d389145b3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fc573-1d70-4cb2-8fa8-d389145b3665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac473fac-1e21-4d1c-97b2-a56112fb6a8f', 'volume_name': 'volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b6ea45-9c8f-4673-ab95-1aa4cbcae10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b6ea45-9c8f-4673-ab95-1aa4cbcae10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cc1b92-8415-4a9b-9c7c-bd4f2e847403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume ac473fac-1e21-4d1c-97b2-a56112fb6a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f', 'volume_size': 1} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (135ff5ef-f19f-4290-ac2c-29bbc5fc9b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef024467-ef05-403a-ac37-77ef3d90a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef024467-ef05-403a-ac37-77ef3d90a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-20134719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:59Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c67187-508e-4040-96e2-3005dac0d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c67187-508e-4040-96e2-3005dac0d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4fb4a3-971e-43b4-8320-10b637638f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4fb4a3-971e-43b4-8320-10b637638f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e', 'volume_name': 'volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fecd2df-9b3f-430d-b2bd-4f3c255f9264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fecd2df-9b3f-430d-b2bd-4f3c255f9264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff276a9-9e6d-4eca-84f0-d3dab56680b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Volume ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e', 'volume_size': 1} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:58 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea 1073741824" returned: 0 in 0.706s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:59 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea Jul 25 02:50:59 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (770a7df9-9b77-4203-b1bf-893ed5337a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ef24cd-cd01-4a62-ad07-ad153544e4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ef24cd-cd01-4a62-ad07-ad153544e4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-974513246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4391e094-9900-4943-a4b3-155f49db6bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:59Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e7ee30-9cae-4c2b-b2ce-16c9a4d14d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e7ee30-9cae-4c2b-b2ce-16c9a4d14d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37b44df-0dfd-4579-9537-6a2fe40c8852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37b44df-0dfd-4579-9537-6a2fe40c8852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4391e094-9900-4943-a4b3-155f49db6bdd', 'volume_name': 'volume-4391e094-9900-4943-a4b3-155f49db6bdd', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68891801-7932-4fe3-a8a2-69d7890a2179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68891801-7932-4fe3-a8a2-69d7890a2179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb7187d-fd8e-445d-916d-cac4a95607e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Volume 4391e094-9900-4943-a4b3-155f49db6bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4391e094-9900-4943-a4b3-155f49db6bdd', 'volume_size': 1} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:59 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea" returned: 0 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273694011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac473fac-1e21-4d1c-97b2-a56112fb6a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:58Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating volume ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:50:59 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac38850-13af-4a78-88ff-29e84dd4769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f 1073741824 Jul 25 02:50:59 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca22a4b-76b4-4cf8-be45-5b281ab2a428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Volume volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea (fb2ba408-f146-4df2-ad99-0e44ef40a6ea): created successfully Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca22a4b-76b4-4cf8-be45-5b281ab2a428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (bc5e456e-3934-45fb-9040-397524232f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-78dd4d4d-e08e-493e-9fa2-197442d21103 tempest-CreateVolumesFromImageTest-351805268 None] Created volume successfully. Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (fe9e930e-60b0-43cf-8940-70771b4cdad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edd6650-8e93-4254-a940-521e77968497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edd6650-8e93-4254-a940-521e77968497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1036387529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d42fa0-e897-413e-8067-e7b47d00ccbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:59Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4e5f53-f6fd-43df-803d-fd13cbcc502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4e5f53-f6fd-43df-803d-fd13cbcc502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9b022a-e44b-4019-84b5-7314628997a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9b022a-e44b-4019-84b5-7314628997a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d42fa0-e897-413e-8067-e7b47d00ccbe', 'volume_name': 'volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f996aedd-0696-4e36-98e0-7febd497c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f996aedd-0696-4e36-98e0-7febd497c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0c2ec9-d5dc-41dd-a239-3c97e6a74f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:50:59 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Volume e3d42fa0-e897-413e-8067-e7b47d00ccbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe', 'volume_size': 1} Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:50:59 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 25 02:50:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f 1073741824" returned: 0 in 0.614s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:00 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f Jul 25 02:51:00 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (dfba38ca-827d-4cd3-9ea7-d737cf58d15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f36363-2b97-4832-be17-f8ab042b31c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f36363-2b97-4832-be17-f8ab042b31c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806742897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fc6403-f695-4c6c-bc7a-a92ef92c5150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:00Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fe0a19-a10b-4a7f-951c-6690af502edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fe0a19-a10b-4a7f-951c-6690af502edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35030771-cc5d-4790-9958-a5cb8cc33fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35030771-cc5d-4790-9958-a5cb8cc33fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fc6403-f695-4c6c-bc7a-a92ef92c5150', 'volume_name': 'volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e009a2-7840-44b9-81d6-4e19463169b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e009a2-7840-44b9-81d6-4e19463169b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80207f67-17fd-46f7-abc8-7f98512d61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Volume b5fc6403-f695-4c6c-bc7a-a92ef92c5150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150', 'volume_size': 1} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:00 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" returned: 0 in 0.320s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-20134719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:59Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Creating volume ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:00 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cc1b92-8415-4a9b-9c7c-bd4f2e847403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:00 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e 1073741824 Jul 25 02:51:00 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad410fb8-848d-482d-a7bd-ce21e6203abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f (ac473fac-1e21-4d1c-97b2-a56112fb6a8f): created successfully Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad410fb8-848d-482d-a7bd-ce21e6203abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (872147d8-e553-4585-a137-c82aa58fc941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bd76c1d3-4a06-4993-8929-52a8a9e16ca0 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created volume successfully. Jul 25 02:51:00 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e 1073741824" returned: 0 in 0.484s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:00 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e Jul 25 02:51:00 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:01 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-974513246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4391e094-9900-4943-a4b3-155f49db6bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:59Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Creating volume 4391e094-9900-4943-a4b3-155f49db6bdd {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:01 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff276a9-9e6d-4eca-84f0-d3dab56680b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d569fd-e307-4643-9730-0b87cfa307ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:01 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd 1073741824 Jul 25 02:51:01 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Volume volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e (ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e): created successfully Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d569fd-e307-4643-9730-0b87cfa307ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (135ff5ef-f19f-4290-ac2c-29bbc5fc9b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-46103ebc-9d17-4c23-8191-9d47bc37cced tempest-CreateVolumesFromImageTest-351805268 None] Created volume successfully. Jul 25 02:51:01 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd 1073741824" returned: 0 in 0.630s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:01 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd Jul 25 02:51:01 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:02 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1036387529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d42fa0-e897-413e-8067-e7b47d00ccbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:50:59Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Creating volume e3d42fa0-e897-413e-8067-e7b47d00ccbe {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:02 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb7187d-fd8e-445d-916d-cac4a95607e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4391e094-9900-4943-a4b3-155f49db6bdd', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705947ef-5fab-412e-b07e-6a206cb82402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:02 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe 1073741824 Jul 25 02:51:02 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Volume volume-4391e094-9900-4943-a4b3-155f49db6bdd (4391e094-9900-4943-a4b3-155f49db6bdd): created successfully Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705947ef-5fab-412e-b07e-6a206cb82402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (770a7df9-9b77-4203-b1bf-893ed5337a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:02 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ef10b7f5-a2c5-494b-839c-85ceb778d700 tempest-CreateVolumesFromImageTest-351805268 None] Created volume successfully. Jul 25 02:51:02 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe 1073741824" returned: 0 in 0.515s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:02 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe Jul 25 02:51:02 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:02 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe" returned: 0 in 0.270s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.755s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806742897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fc6403-f695-4c6c-bc7a-a92ef92c5150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a9a07412949c6a6ef9e1dff1a7ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:00Z,use_quota=True,user_id='0e2e2ca8061540efa0b422a1575850f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Creating volume b5fc6403-f695-4c6c-bc7a-a92ef92c5150 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:03 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0c2ec9-d5dc-41dd-a239-3c97e6a74f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:03 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 1073741824 Jul 25 02:51:03 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a36b90-e325-4f29-ae78-109fdbe7ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Volume volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe (e3d42fa0-e897-413e-8067-e7b47d00ccbe): created successfully Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a36b90-e325-4f29-ae78-109fdbe7ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (fe9e930e-60b0-43cf-8940-70771b4cdad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-398a619c-9ebc-4436-b5f9-465d6a42b437 tempest-CreateVolumesFromImageTest-351805268 None] Created volume successfully. Jul 25 02:51:03 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 1073741824" returned: 0 in 0.568s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Flow 'volume_create_manager' (2eb867c6-ff5e-456a-84fc-3334178a5b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1bf6a7-22f9-4bea-9745-0faeb20cfd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1bf6a7-22f9-4bea-9745-0faeb20cfd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b156183-42eb-4c26-ac99-13944eda219c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a8a5ada7ed4a95ba6daa046a528ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:04Z,use_quota=True,user_id='e32ed786552e492ab6fc2f8458b216f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5082ba37-6d01-4015-9f66-cb0ee105c343),volume_type_id=5082ba37-6d01-4015-9f66-cb0ee105c343)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:03 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 Jul 25 02:51:03 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64dbef7-3828-48cf-b451-56fd7457f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64dbef7-3828-48cf-b451-56fd7457f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79a191-2ac3-4d76-9a95-41f08a5ce64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:51:03 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.075s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80207f67-17fd-46f7-abc8-7f98512d61ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf88b84-aac4-409a-84e6-e03284822645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating offline snapshot 9ca2973c-1604-45d6-b07d-e21c025c8a75 of volume ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:51:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Volume volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 (b5fc6403-f695-4c6c-bc7a-a92ef92c5150): created successfully Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf88b84-aac4-409a-84e6-e03284822645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Flow 'volume_create_manager' (dfba38ca-827d-4cd3-9ea7-d737cf58d15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b53236-7a07-4740-a1f6-dc25f9fdd5d2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6764c270-b92c-4268-be18-cd567eb94a54 tempest-CreateVolumesFromImageTest-351805268 None] Created volume successfully. Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79a191-2ac3-4d76-9a95-41f08a5ce64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b156183-42eb-4c26-ac99-13944eda219c', 'volume_name': 'volume-4b156183-42eb-4c26-ac99-13944eda219c', 'volume_size': 1, 'image_id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c98f0586f91391c6784c8015b43549ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05a8a5ada7ed4a95ba6daa046a528ca3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc8f0257b6de8b48dd21dababbf6fbf68dfb24f975b4c716f54d3d0bbe967523dad8eef77b2a2fde771d5824f6dbd365dfa3835cf5536330a7e4d0a61dd97e72', 'id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'created_at': datetime.datetime(2026, 7, 25, 0, 51, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 51, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b19b27-5925-420e-ba19-5d4db584d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b19b27-5925-420e-ba19-5d4db584d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e1499a-17c4-4e73-b212-b9064c68822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Volume 4b156183-42eb-4c26-ac99-13944eda219c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b156183-42eb-4c26-ac99-13944eda219c', 'volume_size': 1, 'image_id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c98f0586f91391c6784c8015b43549ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05a8a5ada7ed4a95ba6daa046a528ca3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc8f0257b6de8b48dd21dababbf6fbf68dfb24f975b4c716f54d3d0bbe967523dad8eef77b2a2fde771d5824f6dbd365dfa3835cf5536330a7e4d0a61dd97e72', 'id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'created_at': datetime.datetime(2026, 7, 25, 0, 51, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 51, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Trying to clone 4b156183-42eb-4c26-ac99-13944eda219c from image bd041f4d-df52-4d74-8872-8a5c028c8e9e at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:51:04 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f Jul 25 02:51:04 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:51:04 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Image download 0.00 MB at 0.00 MB/s Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0dec6e-b775-470f-aea9-61bfdf2cf001]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:04 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD Jul 25 02:51:04 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:04 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" returned: 0 in 0.412s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:04 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 1G Jul 25 02:51:04 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-b5fc6403-f695-4c6c-bc7a-a92ef92c5150-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:04 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-b5fc6403-f695-4c6c-bc7a-a92ef92c5150-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-quobyte-b5fc6403-f695-4c6c-bc7a-a92ef92c5150" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-b5fc6403-f695-4c6c-bc7a-a92ef92c5150" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c05c66-3c94-475d-b4b4-5f36ce524a10]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:04 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD Jul 25 02:51:04 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:04 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 1G" returned: 0 in 0.474s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:04 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 Jul 25 02:51:04 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:04 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 Jul 25 02:51:04 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Temporary image bd041f4d-df52-4d74-8872-8a5c028c8e9e is fetched for user e32ed786552e492ab6fc2f8458b216f8. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1474bcc7-9d9a-4abd-9eb8-21b3e7885539]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75" returned: 0 in 0.310s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 is being set with open permissions: ugo+rw Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150" returned: 0 in 0.441s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 Jul 25 02:51:05 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD Jul 25 02:51:05 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150 Jul 25 02:51:05 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75" returned: 0 in 0.276s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b5fc6403-f695-4c6c-bc7a-a92ef92c5150" returned: 0 in 0.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-b5fc6403-f695-4c6c-bc7a-a92ef92c5150" released by "delete_volume" :: held 0.774s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info Jul 25 02:51:05 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD Jul 25 02:51:05 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Created reservations ['b0afd2e1-23ae-4578-ac83-486940bd9afc', '46b63593-f000-4235-a8de-56b5e6dc0775', '14a2bd7a-2f91-4588-b031-5a7d4608c91a', '08b2ef0e-4605-4c27-aa36-dad8b5385fad'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:05 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-e3d42fa0-e897-413e-8067-e7b47d00ccbe-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:05 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info is being set with open permissions: ugo+rw Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-e3d42fa0-e897-413e-8067-e7b47d00ccbe-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD" returned: 1 in 0.498s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:05 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info Jul 25 02:51:05 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-quobyte-e3d42fa0-e897-413e-8067-e7b47d00ccbe" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-e3d42fa0-e897-413e-8067-e7b47d00ccbe" acquired by "delete_volume" :: waited 0.034s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:06 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Deleted volume successfully. Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[639bad61-5e9d-483e-a491-5c4e87c1c178]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c4f92afe-b6bc-47ac-ba4b-1d0e67686584 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-b5fc6403-f695-4c6c-bc7a-a92ef92c5150-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:06 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe Jul 25 02:51:06 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:06 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.info" returned: 0 in 0.317s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b156183-42eb-4c26-ac99-13944eda219c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a8a5ada7ed4a95ba6daa046a528ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:04Z,use_quota=True,user_id='e32ed786552e492ab6fc2f8458b216f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5082ba37-6d01-4015-9f66-cb0ee105c343),volume_type_id=5082ba37-6d01-4015-9f66-cb0ee105c343)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Creating volume 4b156183-42eb-4c26-ac99-13944eda219c {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:06 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:06 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c 1073741824 Jul 25 02:51:06 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:06 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9f83de91-76d5-4b22-888b-705e298bbede tempest-CreateVolumesFromSnapshotTest-1158017807 None] Create snapshot completed successfully Jul 25 02:51:06 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe" returned: 0 in 0.451s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:06 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe Jul 25 02:51:06 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:06 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-e3d42fa0-e897-413e-8067-e7b47d00ccbe" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:06 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c 1073741824" returned: 0 in 0.513s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-e3d42fa0-e897-413e-8067-e7b47d00ccbe" released by "delete_volume" :: held 0.780s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:06 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c Jul 25 02:51:06 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Created reservations ['4dd06850-9fae-400f-aca3-38f1c1521c17', '73990528-961f-4b9e-8c53-a0b40161da45', '351b3e01-e028-472b-9883-4e39103075a5', 'bbdf8626-6e41-485a-a454-0144995aef9e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:06 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:06 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-4391e094-9900-4943-a4b3-155f49db6bdd-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-4391e094-9900-4943-a4b3-155f49db6bdd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:07 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-quobyte-4391e094-9900-4943-a4b3-155f49db6bdd" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-4391e094-9900-4943-a4b3-155f49db6bdd" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Attempting download of bd041f4d-df52-4d74-8872-8a5c028c8e9e ((None, [{'url': 'file:///opt/stack/data/glance/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'metadata': {}}])) to volume 4b156183-42eb-4c26-ac99-13944eda219c. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ebeef-227f-4fbc-8f5c-fab1ce06c41a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:07 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.314s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[be941af1-718d-4303-a340-d98858768c38]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Deleted volume successfully. Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-74280b11-add5-45d2-a3a2-82cf2efef1a1 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-e3d42fa0-e897-413e-8067-e7b47d00ccbe-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:07 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd Jul 25 02:51:07 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:07 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m Jul 25 02:51:07 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:07 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m" returned: 0 in 0.470s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:07 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (0b854738-6fb7-4213-be8b-aab7655dd830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023273a4-b541-4910-9d6c-12ce4d843223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd" returned: 0 in 0.621s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023273a4-b541-4910-9d6c-12ce4d843223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530629520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1f4ba6-6a29-4178-b10b-de07e19249ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:08Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3709c464-26d0-4af3-8e83-c505d285eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:07 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd Jul 25 02:51:07 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:07 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m Jul 25 02:51:07 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3709c464-26d0-4af3-8e83-c505d285eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fd4c98-4234-4c8c-a0cf-c4bbaf50a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fd4c98-4234-4c8c-a0cf-c4bbaf50a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1f4ba6-6a29-4178-b10b-de07e19249ea', 'volume_name': 'volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1cbf04-a470-4db0-90a7-e5ad66c8e0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1cbf04-a470-4db0-90a7-e5ad66c8e0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2b8056-83a0-4aac-b050-d1395c8429e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:07 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume 3b1f4ba6-6a29-4178-b10b-de07e19249ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea', 'volume_size': 1} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530629520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1f4ba6-6a29-4178-b10b-de07e19249ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:08Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating volume 3b1f4ba6-6a29-4178-b10b-de07e19249ea {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:07 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:08 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea 1073741824 Jul 25 02:51:08 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:08 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m" returned: 1 in 0.416s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fmiyqr8m' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db0d9d-366d-4446-9fea-f430ba5c5a7b]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (05ecfe90-374b-4e05-93e6-c04ef31e8ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:08 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3307e8-9b0c-41f0-b8b8-72a89544c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD Jul 25 02:51:08 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4391e094-9900-4943-a4b3-155f49db6bdd" returned: 0 in 0.568s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3307e8-9b0c-41f0-b8b8-72a89544c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1542096412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:08Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1351f2ee-d118-46e8-bf3f-22ecd7885932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1351f2ee-d118-46e8-bf3f-22ecd7885932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a041f23a-d3f6-4bb9-8037-2101c73ce44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a041f23a-d3f6-4bb9-8037-2101c73ce44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a', 'volume_name': 'volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b92860-cbc9-4f7b-a317-00f468e61341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b92860-cbc9-4f7b-a317-00f468e61341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f380ab-2b6d-478d-ae33-e087950e6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a', 'volume_size': 1} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-4391e094-9900-4943-a4b3-155f49db6bdd" released by "delete_volume" :: held 1.331s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Created reservations ['112b2c34-5fe0-4dc6-9855-e5410a66954b', 'c5a711b4-068e-4de6-b223-3020092205f5', '7ac46c5a-2189-4d77-8deb-62f0b5289dee', '47086005-6607-4e0c-9c2e-88ca0a5d4172'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:08 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea 1073741824" returned: 0 in 0.715s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:08 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:08 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:08 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD" returned: 0 in 0.678s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:08 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea Jul 25 02:51:08 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (0dd3063e-b56a-4964-a6ed-5b0270996516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac76971-2ad7-4a9e-bc8c-e5a7113cc78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac76971-2ad7-4a9e-bc8c-e5a7113cc78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559615748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319d4914-9ca5-486d-8e0d-af9cd2214898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:09Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9685e73c-11b7-4ece-869a-0777604c6f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9685e73c-11b7-4ece-869a-0777604c6f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04770259-0622-46ea-a7e1-b880a7166e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04770259-0622-46ea-a7e1-b880a7166e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319d4914-9ca5-486d-8e0d-af9cd2214898', 'volume_name': 'volume-319d4914-9ca5-486d-8e0d-af9cd2214898', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178e0fc0-72f6-40ec-af34-af9b7b79ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178e0fc0-72f6-40ec-af34-af9b7b79ac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0de024-4373-4f14-86eb-0a557f2f94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:08 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume 319d4914-9ca5-486d-8e0d-af9cd2214898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319d4914-9ca5-486d-8e0d-af9cd2214898', 'volume_size': 1} Jul 25 02:51:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:09 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD Jul 25 02:51:09 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:09 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Deleted volume successfully. Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d9f7100d-d264-47aa-8bf4-deedae7251ed tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-4391e094-9900-4943-a4b3-155f49db6bdd-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:09 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea" returned: 0 in 0.426s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1542096412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:08Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating volume ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:09 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2b8056-83a0-4aac-b050-d1395c8429e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:09 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a 1073741824 Jul 25 02:51:09 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f247470b-2d73-430e-ad26-a15ec5f46a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:09 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea (3b1f4ba6-6a29-4178-b10b-de07e19249ea): created successfully Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f247470b-2d73-430e-ad26-a15ec5f46a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (0b854738-6fb7-4213-be8b-aab7655dd830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e9cfd736-6aeb-4c8e-85d5-499ea551902a tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created volume successfully. Jul 25 02:51:09 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD" returned: 1 in 0.627s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] bd041f4d-df52-4d74-8872-8a5c028c8e9e was raw, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:09 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c Jul 25 02:51:09 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (fb428555-d68f-42e1-b13c-a74a7cbe5f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cea154c-09db-4ecb-8ebf-9ce7a49c9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cea154c-09db-4ecb-8ebf-9ce7a49c9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81147922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad5aea7-c2c1-4b77-9621-385a155ce046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:09Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e7a05e-29a0-4060-ae4a-1a4f39cdcaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e7a05e-29a0-4060-ae4a-1a4f39cdcaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4ae646-6302-4144-968b-b1b5d116dca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4ae646-6302-4144-968b-b1b5d116dca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad5aea7-c2c1-4b77-9621-385a155ce046', 'volume_name': 'volume-4ad5aea7-c2c1-4b77-9621-385a155ce046', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545ff642-43bb-4264-9753-2b7358a3b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545ff642-43bb-4264-9753-2b7358a3b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4633b7bc-e8bf-4569-b6c8-b2fbd9d7ee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:09 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume 4ad5aea7-c2c1-4b77-9621-385a155ce046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad5aea7-c2c1-4b77-9621-385a155ce046', 'volume_size': 1} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-quobyte-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d9471-db16-4390-b051-e9a6ae86336d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:09 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a 1073741824" returned: 0 in 0.708s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:09 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e Jul 25 02:51:09 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:10 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a Jul 25 02:51:10 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (347b69d0-0bf1-420b-a043-4110c9060787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed32d7-7533-4b23-8776-c9ffc34dfff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed32d7-7533-4b23-8776-c9ffc34dfff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731749562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0267c988-1a88-4852-97e5-d39f94676802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:10Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1ab4a1-d89a-4b96-b735-ae4da4750fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1ab4a1-d89a-4b96-b735-ae4da4750fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a88cec-4df9-4a04-b7e4-d3d4765df2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a88cec-4df9-4a04-b7e4-d3d4765df2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0267c988-1a88-4852-97e5-d39f94676802', 'volume_name': 'volume-0267c988-1a88-4852-97e5-d39f94676802', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28e642b-b019-4946-9f44-4df2f487718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28e642b-b019-4946-9f44-4df2f487718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9397c0-af80-4c08-a2e2-1131f6750f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume 0267c988-1a88-4852-97e5-d39f94676802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0267c988-1a88-4852-97e5-d39f94676802', 'volume_size': 1} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:10 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c" returned: 0 in 0.800s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd041f4d-df52-4d74-8872-8a5c028c8e9e_fo7ggng5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Converted 0.00 MB image at 0.00 MB/s Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:10 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c 1G Jul 25 02:51:10 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:10 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e" returned: 0 in 0.523s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:10 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e Jul 25 02:51:10 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:10 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a" returned: 0 in 0.423s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559615748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319d4914-9ca5-486d-8e0d-af9cd2214898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:09Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating volume 319d4914-9ca5-486d-8e0d-af9cd2214898 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f380ab-2b6d-478d-ae33-e087950e6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78543dd-512f-464f-a368-ae2441c60d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 1073741824 Jul 25 02:51:10 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a (ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a): created successfully Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78543dd-512f-464f-a368-ae2441c60d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (05ecfe90-374b-4e05-93e6-c04ef31e8ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-36eb7e4b-1e4e-4cd1-83c3-96c78f3be1c2 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created volume successfully. Jul 25 02:51:10 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c 1G" returned: 0 in 0.459s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Downloaded image bd041f4d-df52-4d74-8872-8a5c028c8e9e ((None, [{'url': 'file:///opt/stack/data/glance/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'metadata': {}}])) to volume 4b156183-42eb-4c26-ac99-13944eda219c successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Temporary image bd041f4d-df52-4d74-8872-8a5c028c8e9e for user e32ed786552e492ab6fc2f8458b216f8 is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Marking volume 4b156183-42eb-4c26-ac99-13944eda219c as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Copying metadata from image bd041f4d-df52-4d74-8872-8a5c028c8e9e to 4b156183-42eb-4c26-ac99-13944eda219c. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Creating volume glance metadata for volume 4b156183-42eb-4c26-ac99-13944eda219c backed by image bd041f4d-df52-4d74-8872-8a5c028c8e9e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c98f0586f91391c6784c8015b43549ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:51:10 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e" returned: 0 in 0.440s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e" released by "delete_volume" :: held 1.024s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e1499a-17c4-4e73-b212-b9064c68822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b156183-42eb-4c26-ac99-13944eda219c', 'volume_size': 1, 'image_id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c98f0586f91391c6784c8015b43549ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05a8a5ada7ed4a95ba6daa046a528ca3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc8f0257b6de8b48dd21dababbf6fbf68dfb24f975b4c716f54d3d0bbe967523dad8eef77b2a2fde771d5824f6dbd365dfa3835cf5536330a7e4d0a61dd97e72', 'id': 'bd041f4d-df52-4d74-8872-8a5c028c8e9e', 'created_at': datetime.datetime(2026, 7, 25, 0, 51, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 51, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd041f4d-df52-4d74-8872-8a5c028c8e9e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8760ea8a-ca8d-4a0a-8620-a498e571f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Volume volume-4b156183-42eb-4c26-ac99-13944eda219c (4b156183-42eb-4c26-ac99-13944eda219c): created successfully Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8760ea8a-ca8d-4a0a-8620-a498e571f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Flow 'volume_create_manager' (2eb867c6-ff5e-456a-84fc-3334178a5b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:10 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Created reservations ['aecbca32-e846-4f95-942a-1b2e7b7edb4e', 'a693f0b5-3c3b-4b8c-98fa-d6ecee87be9d', '811e8f91-0c3f-4b75-9d0c-9aa41c82705d', 'cbb68df6-2373-45c3-8a1d-b2a4a59e093e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bdd10591-26b1-4f89-9849-dbe01e060d07 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Created volume successfully. Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:11 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:11 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:11 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 1073741824" returned: 0 in 0.618s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:11 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 Jul 25 02:51:11 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:11 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Deleted volume successfully. Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e7b8ece9-7f6b-4c37-9857-3a09639fd76a tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-ab82e9b8-f0c5-44f2-bdff-50f4ed4f4a0e-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:11 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898" returned: 0 in 0.297s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81147922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad5aea7-c2c1-4b77-9621-385a155ce046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:09Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating volume 4ad5aea7-c2c1-4b77-9621-385a155ce046 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:11 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0de024-4373-4f14-86eb-0a557f2f94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319d4914-9ca5-486d-8e0d-af9cd2214898', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a9b7ea-89d1-46a9-80e2-6191ad7801f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:11 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 1073741824 Jul 25 02:51:11 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Acquiring lock "cinder-4b156183-42eb-4c26-ac99-13944eda219c-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:11 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume volume-319d4914-9ca5-486d-8e0d-af9cd2214898 (319d4914-9ca5-486d-8e0d-af9cd2214898): created successfully Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a9b7ea-89d1-46a9-80e2-6191ad7801f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (0dd3063e-b56a-4964-a6ed-5b0270996516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "cinder-4b156183-42eb-4c26-ac99-13944eda219c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6004e75f-0b90-49c1-b21b-70058aa47371 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created volume successfully. Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Acquiring lock "cinder-quobyte-4b156183-42eb-4c26-ac99-13944eda219c" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "cinder-quobyte-4b156183-42eb-4c26-ac99-13944eda219c" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cd0403-c8e5-4d76-b20c-db823a0249a7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:11 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c Jul 25 02:51:11 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-fb2ba408-f146-4df2-ad99-0e44ef40a6ea-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-fb2ba408-f146-4df2-ad99-0e44ef40a6ea-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "cinder-quobyte-fb2ba408-f146-4df2-ad99-0e44ef40a6ea" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:11 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 1073741824" returned: 0 in 0.563s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-fb2ba408-f146-4df2-ad99-0e44ef40a6ea" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aef4d4-52c3-4403-8022-ad287fd4d0e0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:12 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 Jul 25 02:51:12 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:12 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c" returned: 0 in 0.560s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:12 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea Jul 25 02:51:12 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c Jul 25 02:51:12 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:12 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:12 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046" returned: 0 in 0.331s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731749562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0267c988-1a88-4852-97e5-d39f94676802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec1a5ea650c41518fbd0c1c7a24d7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:10Z,use_quota=True,user_id='1b62604174aa4f5d94ca4bb15280900d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Creating volume 0267c988-1a88-4852-97e5-d39f94676802 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:12 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4633b7bc-e8bf-4569-b6c8-b2fbd9d7ee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad5aea7-c2c1-4b77-9621-385a155ce046', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ca74f6-d635-4ffd-b19d-87a21200394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:12 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 1073741824 Jul 25 02:51:12 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:12 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 (4ad5aea7-c2c1-4b77-9621-385a155ce046): created successfully Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ca74f6-d635-4ffd-b19d-87a21200394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:12 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (fb428555-d68f-42e1-b13c-a74a7cbe5f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4b156183-42eb-4c26-ac99-13944eda219c" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "cinder-quobyte-4b156183-42eb-4c26-ac99-13944eda219c" released by "delete_volume" :: held 0.964s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ede4c731-c744-4e3e-b040-cffd58fae5f5 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created volume successfully. Jul 25 02:51:12 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea" returned: 0 in 0.526s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:12 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea Jul 25 02:51:12 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Created reservations ['72859851-e769-4637-ab57-eb10f798be95', '7743b3ef-6e7d-4d52-804f-f12a0a11170d', '653157f1-c817-46a3-8d3f-570cd8ca416e', '3c59ce32-3aaa-4eaa-870e-2ae7a8d0cd55'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:12 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:12 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:12 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fb2ba408-f146-4df2-ad99-0e44ef40a6ea" returned: 0 in 0.336s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-quobyte-fb2ba408-f146-4df2-ad99-0e44ef40a6ea" released by "delete_volume" :: held 0.924s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:12 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Created reservations ['74a97643-1a06-4037-9573-37b1bc5e5ee3', '383eb62d-b301-4bcf-a4af-7e943786aa03', '7b7d8302-58c1-482c-aa09-a49e0b446478', '9bcc683d-e22d-4a30-8f6b-a337451f0450'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:13 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 1073741824" returned: 0 in 0.568s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:13 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Deleted volume successfully. Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:13 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 Jul 25 02:51:13 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6f2630e8-89cc-444f-9a89-12a572645de5 tempest-VolumeAndVolumeTypeFromImageTest-1134345588 None] Lock "cinder-4b156183-42eb-4c26-ac99-13944eda219c-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:13 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:13 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:13 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:13 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.340s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9397c0-af80-4c08-a2e2-1131f6750f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0267c988-1a88-4852-97e5-d39f94676802', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6e8935-1a63-479e-b093-ba766ae5c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Deleted volume successfully. Jul 25 02:51:13 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Volume volume-0267c988-1a88-4852-97e5-d39f94676802 (0267c988-1a88-4852-97e5-d39f94676802): created successfully Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6e8935-1a63-479e-b093-ba766ae5c764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Flow 'volume_create_manager' (347b69d0-0bf1-420b-a043-4110c9060787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e79bce59-7622-4b8f-89e1-3a72429a4264 tempest-CreateVolumesFromImageTest-351805268 None] Lock "cinder-fb2ba408-f146-4df2-ad99-0e44ef40a6ea-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dda195f4-2897-42a7-b9cd-eec58363ea83 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created volume successfully. Jul 25 02:51:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-0267c988-1a88-4852-97e5-d39f94676802-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-0267c988-1a88-4852-97e5-d39f94676802-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-0267c988-1a88-4852-97e5-d39f94676802" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-0267c988-1a88-4852-97e5-d39f94676802" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e5900-c224-431c-9ae2-b9815de1498e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:14 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 Jul 25 02:51:14 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:15 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:15 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802 Jul 25 02:51:15 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:15 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0267c988-1a88-4852-97e5-d39f94676802" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-0267c988-1a88-4852-97e5-d39f94676802" released by "delete_volume" :: held 0.759s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['c5bcb687-9e91-4d4a-b7a1-3e5be836f811', 'ae6f559b-db96-4124-b297-19ba416815e1', '61f5d6c2-1f94-4885-be98-4229c7e29fdc', '6cd14fa5-556d-4df6-9988-9a8a938b76bb'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:15 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:15 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-4ad5aea7-c2c1-4b77-9621-385a155ce046-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-4ad5aea7-c2c1-4b77-9621-385a155ce046-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-4ad5aea7-c2c1-4b77-9621-385a155ce046" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-4ad5aea7-c2c1-4b77-9621-385a155ce046" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e99a94-e953-4239-9685-f364e0a36a70]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:16 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.402s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleted volume successfully. Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0ea92c22-6572-40fc-af50-5f1eadf7c6b1 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-0267c988-1a88-4852-97e5-d39f94676802-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:16 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 Jul 25 02:51:16 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Flow 'volume_create_manager' (332980bf-de00-4954-bb88-1b66931867a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea5b59f-dafd-42ff-9817-ca21b5bba0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea5b59f-dafd-42ff-9817-ca21b5bba0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346553118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a939623-a771-4042-a9d1-781254fbd12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8e8a99c5f040e8bb57cf3b9fc2130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:16Z,use_quota=True,user_id='542c6eb2d0cb4fb78dea1d231d142431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fb7eac-3c24-49c6-97c1-682b96ad12ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fb7eac-3c24-49c6-97c1-682b96ad12ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbebc580-0576-4fd3-a7ed-f546764bb1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbebc580-0576-4fd3-a7ed-f546764bb1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a939623-a771-4042-a9d1-781254fbd12b', 'volume_name': 'volume-6a939623-a771-4042-a9d1-781254fbd12b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067f49d6-aead-4678-9960-8a503ee085f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067f49d6-aead-4678-9960-8a503ee085f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d63e087-ee3d-4a60-8400-b2079d4a4e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:16 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Volume 6a939623-a771-4042-a9d1-781254fbd12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a939623-a771-4042-a9d1-781254fbd12b', 'volume_size': 1} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346553118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a939623-a771-4042-a9d1-781254fbd12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8e8a99c5f040e8bb57cf3b9fc2130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:16Z,use_quota=True,user_id='542c6eb2d0cb4fb78dea1d231d142431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Creating volume 6a939623-a771-4042-a9d1-781254fbd12b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:16 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:16 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046" returned: 0 in 0.626s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:16 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b 1073741824 Jul 25 02:51:16 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:16 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046 Jul 25 02:51:16 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:16 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-4ad5aea7-c2c1-4b77-9621-385a155ce046" returned: 0 in 0.336s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-4ad5aea7-c2c1-4b77-9621-385a155ce046" released by "delete_volume" :: held 1.043s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['66187d2e-b347-41d8-be4b-735c695730be', 'bc6c6490-6046-4284-913d-70e8c70ea57e', '992598fa-47ea-4a14-9e5c-0cae8d6cc001', '9ef0d2d3-9631-400e-bf92-097c370cecfe'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:17 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b 1073741824" returned: 0 in 0.569s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:17 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:17 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:17 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b Jul 25 02:51:17 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:17 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleted volume successfully. Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-e731e5cd-d3c4-4a25-be6e-5df26c4f149b tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-4ad5aea7-c2c1-4b77-9621-385a155ce046-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:17 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b" returned: 0 in 0.305s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d63e087-ee3d-4a60-8400-b2079d4a4e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a939623-a771-4042-a9d1-781254fbd12b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a57d691-b043-4aa1-ba4a-ecde39b23a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:17 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Volume volume-6a939623-a771-4042-a9d1-781254fbd12b (6a939623-a771-4042-a9d1-781254fbd12b): created successfully Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a57d691-b043-4aa1-ba4a-ecde39b23a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Flow 'volume_create_manager' (332980bf-de00-4954-bb88-1b66931867a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-cb9357d9-1b42-4111-b155-b9032b4a12d6 tempest-ProjectReaderTests-216100223 None] Created volume successfully. Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (d186b937-c8cd-41c2-b916-2cd5995ae1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1615b413-8547-4182-8e16-be0d6e431b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1615b413-8547-4182-8e16-be0d6e431b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68128123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec6c355-1f88-4225-bf53-39e939bbb72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:18Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4194c1-8b1c-48c9-8308-728d0e4dd1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4194c1-8b1c-48c9-8308-728d0e4dd1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3597e0d0-014a-4749-84c8-cf4aead39ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3597e0d0-014a-4749-84c8-cf4aead39ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec6c355-1f88-4225-bf53-39e939bbb72a', 'volume_name': 'volume-1ec6c355-1f88-4225-bf53-39e939bbb72a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b4e8db-95f4-404d-97c0-af2868227e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b4e8db-95f4-404d-97c0-af2868227e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51cb386-be41-4491-b485-018cdd57a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:18 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Volume 1ec6c355-1f88-4225-bf53-39e939bbb72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec6c355-1f88-4225-bf53-39e939bbb72a', 'volume_size': 1} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68128123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec6c355-1f88-4225-bf53-39e939bbb72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:18Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Creating volume 1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:18 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-319d4914-9ca5-486d-8e0d-af9cd2214898-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:18 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a 1073741824 Jul 25 02:51:18 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-319d4914-9ca5-486d-8e0d-af9cd2214898-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-319d4914-9ca5-486d-8e0d-af9cd2214898" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-319d4914-9ca5-486d-8e0d-af9cd2214898" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4533b6-8b96-47f0-ba65-421304186226]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:18 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 Jul 25 02:51:18 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:18 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:18 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a 1073741824" returned: 0 in 0.573s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898" returned: 0 in 0.450s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:18 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898 Jul 25 02:51:18 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:18 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a Jul 25 02:51:18 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Acquiring lock "cinder-6a939623-a771-4042-a9d1-781254fbd12b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Lock "cinder-6a939623-a771-4042-a9d1-781254fbd12b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Acquiring lock "cinder-quobyte-6a939623-a771-4042-a9d1-781254fbd12b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Lock "cinder-quobyte-6a939623-a771-4042-a9d1-781254fbd12b" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f8e207-0b71-41ce-a0b4-22e75b28e02c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:19 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-319d4914-9ca5-486d-8e0d-af9cd2214898" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:19 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a" returned: 0 in 0.307s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-319d4914-9ca5-486d-8e0d-af9cd2214898" released by "delete_volume" :: held 0.844s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51cb386-be41-4491-b485-018cdd57a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec6c355-1f88-4225-bf53-39e939bbb72a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8250b439-81ee-4e2e-a0f7-65e3a2bb07dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:19 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b Jul 25 02:51:19 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:19 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Volume volume-1ec6c355-1f88-4225-bf53-39e939bbb72a (1ec6c355-1f88-4225-bf53-39e939bbb72a): created successfully Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8250b439-81ee-4e2e-a0f7-65e3a2bb07dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (d186b937-c8cd-41c2-b916-2cd5995ae1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f3952824-07ac-4567-b1ec-7ce854b23246 tempest-ProjectReaderTests-1529490971 None] Created volume successfully. Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['f411867b-c1ab-4eff-befe-9c23e89a3150', '1029af0e-77bf-4afa-8ed4-b063a026a84c', 'c091de94-0618-4d6c-8910-4395644e4faf', '5170766d-efff-4eff-b97f-dc16352071c9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:19 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:19 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:19 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b" returned: 0 in 0.456s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:19 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b Jul 25 02:51:19 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a" acquired by "delete_volume" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e4bd1b-b14d-4007-9ca2-ae1077b3cec7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:19 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:19 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleted volume successfully. Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-744e2166-643c-4b74-a43b-e41bb7f61ebe tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-319d4914-9ca5-486d-8e0d-af9cd2214898-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:19 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a Jul 25 02:51:19 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:19 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6a939623-a771-4042-a9d1-781254fbd12b" returned: 0 in 0.349s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Lock "cinder-quobyte-6a939623-a771-4042-a9d1-781254fbd12b" released by "delete_volume" :: held 0.887s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Created reservations ['10a48bef-6da7-4bbb-a472-a961682c74cd', 'cb2b50d7-f15f-442f-8bff-c2a29e7ab2f0', 'e445eddd-d92b-4965-b05c-c777b322abc4', '7e5ae6eb-0252-43a5-9f62-660de9eb3473'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (184f7403-0f09-4dff-bdfe-67899740d7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0e117b-2c99-4719-a89d-3c8c5290dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:19 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a" returned: 0 in 0.475s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:19 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:19 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:19 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0e117b-2c99-4719-a89d-3c8c5290dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418247254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e3763a-2cce-47ad-9f5d-56907734e783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:20Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29de6cfa-4a67-4835-b007-f036a5c4819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29de6cfa-4a67-4835-b007-f036a5c4819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839e91e3-66bd-40b5-aaf5-e95e5ef178b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839e91e3-66bd-40b5-aaf5-e95e5ef178b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e3763a-2cce-47ad-9f5d-56907734e783', 'volume_name': 'volume-b7e3763a-2cce-47ad-9f5d-56907734e783', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25edf6ac-b0c2-422f-b0e5-451d46693a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25edf6ac-b0c2-422f-b0e5-451d46693a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726b675e-aa2c-4451-a36b-f38af5a4d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume b7e3763a-2cce-47ad-9f5d-56907734e783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e3763a-2cce-47ad-9f5d-56907734e783', 'volume_size': 1} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418247254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e3763a-2cce-47ad-9f5d-56907734e783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:20Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Creating volume b7e3763a-2cce-47ad-9f5d-56907734e783 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:20 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:20 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 1073741824 Jul 25 02:51:20 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:20 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a Jul 25 02:51:20 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:20 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a" returned: 0 in 0.305s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a" released by "delete_volume" :: held 0.916s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:20 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Deleted volume successfully. Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d97f578-ec95-401e-8cab-dce4d5291b58 tempest-ProjectReaderTests-216100223 None] Lock "cinder-6a939623-a771-4042-a9d1-781254fbd12b-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['b0d909ff-3e8d-4693-ac03-cd2f432fbedf', '559c3bc6-de85-4e8f-a363-e179fc2c3bf8', 'fb2eacb1-bd57-433d-9a33-608df1ece22e', '1129beec-681a-4038-9c3e-ccc000cd33a8'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:20 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:20 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Flow 'volume_create_manager' (46b45d8e-3890-4f68-94b8-1f64096e984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40069a1-c078-4194-ba75-812c5890b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40069a1-c078-4194-ba75-812c5890b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268392755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4e7270-8ec9-45c5-85d6-a732bf7012b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8e8a99c5f040e8bb57cf3b9fc2130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:21Z,use_quota=True,user_id='542c6eb2d0cb4fb78dea1d231d142431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac731370-f6fd-4f80-9f2e-339bf7f51451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac731370-f6fd-4f80-9f2e-339bf7f51451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1342e920-91f7-41ea-8a19-06e3c6b0f1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1342e920-91f7-41ea-8a19-06e3c6b0f1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4e7270-8ec9-45c5-85d6-a732bf7012b6', 'volume_name': 'volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a11bc-9730-478a-a5ba-277eaccae0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a11bc-9730-478a-a5ba-277eaccae0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b2f002-f8aa-4ec6-87ac-7e9a8c3ce94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:20 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Volume 6c4e7270-8ec9-45c5-85d6-a732bf7012b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6', 'volume_size': 1} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 1073741824" returned: 0 in 0.727s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:20 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 Jul 25 02:51:20 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:20 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleted volume successfully. Jul 25 02:51:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-40dc9ad2-62b8-45cb-9b32-02133cffdaba tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-ea2c6e42-1e7e-4a55-a274-b3e1d5fcb24a-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:21 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783" returned: 0 in 0.237s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.534s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726b675e-aa2c-4451-a36b-f38af5a4d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e3763a-2cce-47ad-9f5d-56907734e783', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be2759a-cc36-4383-9ca1-b727b623cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Creating offline snapshot d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 of volume 1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:51:21 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume volume-b7e3763a-2cce-47ad-9f5d-56907734e783 (b7e3763a-2cce-47ad-9f5d-56907734e783): created successfully Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be2759a-cc36-4383-9ca1-b727b623cc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (184f7403-0f09-4dff-bdfe-67899740d7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef79209-bdd1-4500-b4bf-b4b6cdb1ea52]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:21 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b9f13941-d08a-46f3-a20c-77154efb7c4d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created volume successfully. Jul 25 02:51:21 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a Jul 25 02:51:21 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:21 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a" returned: 0 in 0.353s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:21 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 1G Jul 25 02:51:21 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-3b1f4ba6-6a29-4178-b10b-de07e19249ea-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-3b1f4ba6-6a29-4178-b10b-de07e19249ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-3b1f4ba6-6a29-4178-b10b-de07e19249ea" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-3b1f4ba6-6a29-4178-b10b-de07e19249ea" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d243c660-09d6-4f3a-b8a6-10d653c5eebd]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:21 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea Jul 25 02:51:21 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:21 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 1G" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec6c355-1f88-4225-bf53-39e939bbb72a -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:21 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec6c355-1f88-4225-bf53-39e939bbb72a -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 Jul 25 02:51:21 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:22 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea" returned: 0 in 0.376s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:22 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea Jul 25 02:51:22 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:22 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec6c355-1f88-4225-bf53-39e939bbb72a -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" returned: 0 in 0.312s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:22 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 is being set with open permissions: ugo+rw Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:22 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 Jul 25 02:51:22 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:22 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-3b1f4ba6-6a29-4178-b10b-de07e19249ea" returned: 0 in 0.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-3b1f4ba6-6a29-4178-b10b-de07e19249ea" released by "delete_volume" :: held 0.716s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (d810a79f-9ab7-46de-adaa-7790e45b9bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266f5d02-5940-4520-8b97-482a40bd8633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266f5d02-5940-4520-8b97-482a40bd8633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835877622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e291be-31e6-4f2a-964f-124a054ecb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:22Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62803e2f-62ad-441d-bfe8-6d64018f8210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62803e2f-62ad-441d-bfe8-6d64018f8210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688ff68f-0401-460d-baea-16723de2db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688ff68f-0401-460d-baea-16723de2db56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e291be-31e6-4f2a-964f-124a054ecb88', 'volume_name': 'volume-15e291be-31e6-4f2a-964f-124a054ecb88', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208c30ef-92b2-409e-9aeb-2071a1fe898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208c30ef-92b2-409e-9aeb-2071a1fe898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ffab9d-a306-418b-bb38-ade9d9a3c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume 15e291be-31e6-4f2a-964f-124a054ecb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e291be-31e6-4f2a-964f-124a054ecb88', 'volume_size': 1} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" returned: 0 in 0.369s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['6c0f69f2-72a2-4722-9dd9-b5b6e7622639', '84ad3051-10a4-41b8-985c-95af593abd7f', 'f19d7d92-c3b1-4692-8275-ce402664c2c2', '7c8785a9-59a2-482d-8dab-fe342252eebb'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:22 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info Jul 25 02:51:22 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:22 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:22 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (dab2a9f1-bbba-41f0-a34d-3b02ca3ddd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6e8ed6-dcda-42d5-93da-af21852c7a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-9ca2973c-1604-45d6-b07d-e21c025c8a75-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6e8ed6-dcda-42d5-93da-af21852c7a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2068526060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0144945f-bf80-45f0-8861-faa4e45eda8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:23Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40571cad-95b4-45e8-a675-d07a564aba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40571cad-95b4-45e8-a675-d07a564aba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedb70e7-4069-491d-91e3-112d569519ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedb70e7-4069-491d-91e3-112d569519ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0144945f-bf80-45f0-8861-faa4e45eda8d', 'volume_name': 'volume-0144945f-bf80-45f0-8861-faa4e45eda8d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc6a4f8-a2a6-4533-bf0f-428621f1658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc6a4f8-a2a6-4533-bf0f-428621f1658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:22 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49811f66-d0fe-475c-8060-2ac2c867e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:22 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume 0144945f-bf80-45f0-8861-faa4e45eda8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0144945f-bf80-45f0-8861-faa4e45eda8d', 'volume_size': 1} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-9ca2973c-1604-45d6-b07d-e21c025c8a75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:22 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info is being set with open permissions: ugo+rw Jul 25 02:51:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-9ca2973c-1604-45d6-b07d-e21c025c8a75" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:23 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info Jul 25 02:51:23 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:23 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-9ca2973c-1604-45d6-b07d-e21c025c8a75" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleting offline snapshot 9ca2973c-1604-45d6-b07d-e21c025c8a75 of volume ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] snapshot_file for this snap is: volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.361s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleted volume successfully. Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644657b-c3b0-4005-b1a3-658e746b1303]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ec9c8509-3402-43c3-aa74-1fa5c4317312 tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-3b1f4ba6-6a29-4178-b10b-de07e19249ea-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:23 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 Jul 25 02:51:23 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:23 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.info" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.534s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268392755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4e7270-8ec9-45c5-85d6-a732bf7012b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8e8a99c5f040e8bb57cf3b9fc2130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:21Z,use_quota=True,user_id='542c6eb2d0cb4fb78dea1d231d142431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Creating volume 6c4e7270-8ec9-45c5-85d6-a732bf7012b6 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:23 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:23 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 1073741824 Jul 25 02:51:23 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a7757ba1-569c-48ef-81b4-784b8142833a tempest-ProjectReaderTests-1529490971 None] Create snapshot completed successfully Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (38879d63-6be9-47bf-82ab-bf363b7eca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876df40-891e-4da5-9bae-95d68b4c5385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:23 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876df40-891e-4da5-9bae-95d68b4c5385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836109225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fb996e-f9f4-44b3-bfb0-02f3f6de0a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:23Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b150b37f-2cfd-4c19-9897-e3290dc49412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b150b37f-2cfd-4c19-9897-e3290dc49412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a5c58e-0d35-44b2-a086-bb69b2e3f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a5c58e-0d35-44b2-a086-bb69b2e3f01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91fb996e-f9f4-44b3-bfb0-02f3f6de0a88', 'volume_name': 'volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2827446d-2b46-485c-b35c-723a4742b851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2827446d-2b46-485c-b35c-723a4742b851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e518fecd-fe83-45e8-afa6-f3417e85f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:23 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume 91fb996e-f9f4-44b3-bfb0-02f3f6de0a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88', 'volume_size': 1} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75" returned: 0 in 0.472s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d239f77-090e-470e-8835-be681c6c266a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:23 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f Jul 25 02:51:23 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-1ec6c355-1f88-4225-bf53-39e939bbb72a" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (d8e3d155-be5a-4731-a788-bb76e12283dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddf378f-b636-40cb-9416-7845a3ba676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:23 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 1073741824" returned: 0 in 0.639s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-1ec6c355-1f88-4225-bf53-39e939bbb72a" acquired by "delete_snapshot" :: waited 0.091s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddf378f-b636-40cb-9416-7845a3ba676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602720321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d11900-ccd4-42d5-b778-d21eb894f14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:24Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb3523d-4513-49bb-93bc-0c1bf5fd7c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb3523d-4513-49bb-93bc-0c1bf5fd7c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239052c9-6f2e-4385-afcc-9efff04cc52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239052c9-6f2e-4385-afcc-9efff04cc52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d11900-ccd4-42d5-b778-d21eb894f14a', 'volume_name': 'volume-c2d11900-ccd4-42d5-b778-d21eb894f14a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d6598-2583-4bdd-bd58-db19c7a4a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d6598-2583-4bdd-bd58-db19c7a4a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8b8267-d207-44c5-8158-858edb0c76b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume c2d11900-ccd4-42d5-b778-d21eb894f14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d11900-ccd4-42d5-b778-d21eb894f14a', 'volume_size': 1} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" acquired by "_delete_snapshot" :: waited 0.090s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Deleting offline snapshot d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 of volume 1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] snapshot_file for this snap is: volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fcdaf0-f6b9-4fc9-8dc5-32f29eb587a5]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 Jul 25 02:51:24 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" returned: 0 in 0.570s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 Jul 25 02:51:24 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 Jul 25 02:51:24 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (c04dd8f6-c24a-43b4-9075-6e6c27f67063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907215b-3b49-4d30-aced-98b1e1bbd022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907215b-3b49-4d30-aced-98b1e1bbd022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1787703791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf848d8-5c18-4e75-9749-3c541e423fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:24Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0222c52-b864-475d-ae75-724ded4e792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0222c52-b864-475d-ae75-724ded4e792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc48266b-6d96-470e-9826-37d764b27348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc48266b-6d96-470e-9826-37d764b27348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf848d8-5c18-4e75-9749-3c541e423fcd', 'volume_name': 'volume-0bf848d8-5c18-4e75-9749-3c541e423fcd', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0527ed4b-67e9-4df3-82c1-daf4078644c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0527ed4b-67e9-4df3-82c1-daf4078644c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe35966a-f965-4039-bb2f-758c61dd63af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume 0bf848d8-5c18-4e75-9749-3c541e423fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf848d8-5c18-4e75-9749-3c541e423fcd', 'volume_size': 1} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835877622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e291be-31e6-4f2a-964f-124a054ecb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:22Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Creating volume 15e291be-31e6-4f2a-964f-124a054ecb88 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:24 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b2f002-f8aa-4ec6-87ac-7e9a8c3ce94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f46b715-98d8-4b36-83c3-81c42774b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:24 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 1073741824 Jul 25 02:51:24 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Volume volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 (6c4e7270-8ec9-45c5-85d6-a732bf7012b6): created successfully Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f46b715-98d8-4b36-83c3-81c42774b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Flow 'volume_create_manager' (46b45d8e-3890-4f68-94b8-1f64096e984f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:24 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-84c21e70-d949-4f9c-b792-7604a5274700 tempest-ProjectReaderTests-216100223 None] Created volume successfully. Jul 25 02:51:24 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" returned: 0 in 0.410s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec6c355-1f88-4225-bf53-39e939bbb72a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34fac28-1d19-49be-a9c8-d4fcee620113]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75" returned: 0 in 0.487s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75 Jul 25 02:51:24 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a Jul 25 02:51:24 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 1073741824" returned: 0 in 0.486s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:24 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f.9ca2973c-1604-45d6-b07d-e21c025c8a75" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 Jul 25 02:51:24 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:24 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a" returned: 0 in 0.427s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-9ca2973c-1604-45d6-b07d-e21c025c8a75" released by "_delete_snapshot" :: held 1.973s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" released by "delete_snapshot" :: held 2.013s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:25 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 Jul 25 02:51:25 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['3c849c9d-259e-41eb-80cc-beab4d2de16b', '7c13023f-f157-44e7-ba94-fcf2fb2c2223', '08f8c391-2ddd-4a77-8b45-e14537025791', '3bcbfb84-8c36-4af5-af07-dccce2d12557'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Acquiring lock "cinder-6c4e7270-8ec9-45c5-85d6-a732bf7012b6-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Delete snapshot completed successfully. Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1e4d948d-e78a-439a-ab7d-8cd4317d6e4d tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-9ca2973c-1604-45d6-b07d-e21c025c8a75-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Lock "cinder-6c4e7270-8ec9-45c5-85d6-a732bf7012b6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:25 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88" returned: 0 in 0.320s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2068526060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0144945f-bf80-45f0-8861-faa4e45eda8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:23Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Creating volume 0144945f-bf80-45f0-8861-faa4e45eda8d {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:25 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:25 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d 1073741824 Jul 25 02:51:25 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ffab9d-a306-418b-bb38-ade9d9a3c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e291be-31e6-4f2a-964f-124a054ecb88', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c843d0-e1d0-42d8-af7e-656838eec93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Acquiring lock "cinder-quobyte-6c4e7270-8ec9-45c5-85d6-a732bf7012b6" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:25 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume volume-15e291be-31e6-4f2a-964f-124a054ecb88 (15e291be-31e6-4f2a-964f-124a054ecb88): created successfully Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c843d0-e1d0-42d8-af7e-656838eec93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (d810a79f-9ab7-46de-adaa-7790e45b9bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Lock "cinder-quobyte-6c4e7270-8ec9-45c5-85d6-a732bf7012b6" acquired by "delete_volume" :: waited 0.039s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-89a8295e-51b2-4ee1-98d3-d51ec77152b9 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created volume successfully. Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a564007-da66-4d70-a5d8-e149b7f61f0b]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:25 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" returned: 0 in 0.496s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:25 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 Jul 25 02:51:25 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:25 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3 Jul 25 02:51:25 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:25 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d 1073741824" returned: 0 in 0.439s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:25 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a.d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:25 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d Jul 25 02:51:25 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:25 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6" returned: 0 in 0.395s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3" released by "_delete_snapshot" :: held 1.726s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-1ec6c355-1f88-4225-bf53-39e939bbb72a" released by "delete_snapshot" :: held 1.827s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:25 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6 Jul 25 02:51:25 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Created reservations ['ddd6f0e6-34d2-4bdd-97ae-6ab0b9df0874', 'f8a1da71-714e-4ab8-b163-5cc219af5727', 'ddd4ef9b-5179-4974-968b-46c90ae6f437', 'd7766bc3-c94b-4016-bda5-ae8be94485ee'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Delete snapshot completed successfully. Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4c36e449-a8de-4ec1-bad8-035d00679570 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-d7ee3e7e-3066-4e18-b9a4-edaaeab31ce3-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:25 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836109225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fb996e-f9f4-44b3-bfb0-02f3f6de0a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:23Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Creating volume 91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:26 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 1073741824 Jul 25 02:51:26 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49811f66-d0fe-475c-8060-2ac2c867e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0144945f-bf80-45f0-8861-faa4e45eda8d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e5ce7a-269c-40cf-a695-27428d554e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:26 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume volume-0144945f-bf80-45f0-8861-faa4e45eda8d (0144945f-bf80-45f0-8861-faa4e45eda8d): created successfully Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e5ce7a-269c-40cf-a695-27428d554e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (dab2a9f1-bbba-41f0-a34d-3b02ca3ddd9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9298dfad-beb1-46e2-83cd-90bb9c51bf11 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created volume successfully. Jul 25 02:51:26 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-6c4e7270-8ec9-45c5-85d6-a732bf7012b6" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Lock "cinder-quobyte-6c4e7270-8ec9-45c5-85d6-a732bf7012b6" released by "delete_volume" :: held 0.799s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-1ec6c355-1f88-4225-bf53-39e939bbb72a-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-ac473fac-1e21-4d1c-97b2-a56112fb6a8f-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-1ec6c355-1f88-4225-bf53-39e939bbb72a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-ac473fac-1e21-4d1c-97b2-a56112fb6a8f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Created reservations ['bbb3f8e3-5fc2-4826-9970-58bb7a5d188e', 'fa64e8ca-152a-4797-ae12-0acfcaf171b9', '422d67bd-5c8f-4c63-af96-5ea937fd5be4', '24ded55a-1f76-4438-8d2f-fc5a7e1c5e46'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-1ec6c355-1f88-4225-bf53-39e939bbb72a" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-1ec6c355-1f88-4225-bf53-39e939bbb72a" acquired by "delete_volume" :: waited 0.046s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "cinder-quobyte-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[873e6f10-1d11-4c33-8d4e-c8903cd2b9cd]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" acquired by "delete_volume" :: waited 0.052s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[30519e91-716c-4fe5-9d05-17252000570a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a Jul 25 02:51:26 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:26 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f Jul 25 02:51:26 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 1073741824" returned: 0 in 0.620s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 Jul 25 02:51:26 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:26 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Deleted volume successfully. Jul 25 02:51:26 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a" returned: 0 in 0.470s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-9907299b-e9b8-4480-bcdf-5a8a144ff266 tempest-ProjectReaderTests-216100223 None] Lock "cinder-6c4e7270-8ec9-45c5-85d6-a732bf7012b6-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:26 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" returned: 0 in 0.412s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:26 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f Jul 25 02:51:26 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88" returned: 0 in 0.277s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.900s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602720321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d11900-ccd4-42d5-b778-d21eb894f14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:24Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Creating volume c2d11900-ccd4-42d5-b778-d21eb894f14a {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:26 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e518fecd-fe83-45e8-afa6-f3417e85f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:26 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a 1073741824 Jul 25 02:51:26 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecebaaa8-9734-45e1-abb5-7aa38f3d1839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 (91fb996e-f9f4-44b3-bfb0-02f3f6de0a88): created successfully Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecebaaa8-9734-45e1-abb5-7aa38f3d1839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (38879d63-6be9-47bf-82ab-bf363b7eca98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a674587a-922f-49ef-82dc-e86cbd16f40e tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created volume successfully. Jul 25 02:51:27 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ec6c355-1f88-4225-bf53-39e939bbb72a" returned: 0 in 0.275s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-1ec6c355-1f88-4225-bf53-39e939bbb72a" released by "delete_volume" :: held 0.828s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:27 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" returned: 0 in 0.281s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-quobyte-ac473fac-1e21-4d1c-97b2-a56112fb6a8f" released by "delete_volume" :: held 0.768s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Created reservations ['927bbd25-67ae-4087-b4ca-392ecc4c5af9', 'b7abbb79-4f3e-4361-bc74-485dc98a0d78', '36e18cf3-67b5-409d-96af-85f4a489fc47', '552a1b0e-757b-44d5-a628-78ed280ae5ae'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Created reservations ['54a9a91d-8a6b-4af8-a438-9cd2cf13f01c', 'a357d7ae-8c63-42da-8042-71c3f4b23eaf', '2242794c-4c82-489f-833d-962542efce87', 'a5486db2-b432-49c3-8e1d-4e8ea65ec6f4'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:27 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:27 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:27 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:27 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:27 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a 1073741824" returned: 0 in 0.641s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:27 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a Jul 25 02:51:27 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:27 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Deleted volume successfully. Jul 25 02:51:27 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.501s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Deleted volume successfully. Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-38f1cbd0-a55e-42c9-9615-64f4baa6b3cb tempest-CreateVolumesFromSnapshotTest-1158017807 None] Lock "cinder-ac473fac-1e21-4d1c-97b2-a56112fb6a8f-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:27 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2b812ab2-fdda-42d4-9dbb-0062250814b8 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-1ec6c355-1f88-4225-bf53-39e939bbb72a-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:28 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1787703791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf848d8-5c18-4e75-9749-3c541e423fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1328b71f00294094a3097f2845621a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:24Z,use_quota=True,user_id='a406d0208aa54ad6afbf6a5b2659c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Creating volume 0bf848d8-5c18-4e75-9749-3c541e423fcd {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:28 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8b8267-d207-44c5-8158-858edb0c76b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d11900-ccd4-42d5-b778-d21eb894f14a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e22a0f-c141-4fb1-98f3-381db9ed492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:28 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd 1073741824 Jul 25 02:51:28 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:28 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume volume-c2d11900-ccd4-42d5-b778-d21eb894f14a (c2d11900-ccd4-42d5-b778-d21eb894f14a): created successfully Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e22a0f-c141-4fb1-98f3-381db9ed492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (d8e3d155-be5a-4731-a788-bb76e12283dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:28 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4e094829-2fd4-4f4e-a2fc-c705f3b09f07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created volume successfully. Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (6fd14cd5-47bb-4755-aca7-0a88ecb77dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf9ecd4-2598-4d42-9fb2-953d824eee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf9ecd4-2598-4d42-9fb2-953d824eee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246365713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06058db-1baf-4a92-a9bc-eba2c7d83aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:28Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d241c3ba-819f-4412-a547-a1b9b56dda48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d241c3ba-819f-4412-a547-a1b9b56dda48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03aa49f-1d63-4f0b-b46e-8e35df421e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03aa49f-1d63-4f0b-b46e-8e35df421e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a06058db-1baf-4a92-a9bc-eba2c7d83aab', 'volume_name': 'volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dc8497-25d0-4539-a54f-c6ae1c91577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dc8497-25d0-4539-a54f-c6ae1c91577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5a2e37-fc74-4529-80e0-daee98bf7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:28 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Volume a06058db-1baf-4a92-a9bc-eba2c7d83aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab', 'volume_size': 1} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:28 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd 1073741824" returned: 0 in 0.585s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:28 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd Jul 25 02:51:28 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:28 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246365713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06058db-1baf-4a92-a9bc-eba2c7d83aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:28Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Creating volume a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:29 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe35966a-f965-4039-bb2f-758c61dd63af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf848d8-5c18-4e75-9749-3c541e423fcd', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:29 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab 1073741824 Jul 25 02:51:29 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4e0302-b8c8-47a3-a2a3-1aa5b694163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Volume volume-0bf848d8-5c18-4e75-9749-3c541e423fcd (0bf848d8-5c18-4e75-9749-3c541e423fcd): created successfully Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4e0302-b8c8-47a3-a2a3-1aa5b694163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Flow 'volume_create_manager' (c04dd8f6-c24a-43b4-9075-6e6c27f67063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c1709a9b-1018-470d-ad5b-648f950d9c07 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created volume successfully. Jul 25 02:51:29 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab 1073741824" returned: 0 in 0.573s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:29 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab Jul 25 02:51:29 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:29 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab" returned: 0 in 0.285s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5a2e37-fc74-4529-80e0-daee98bf7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bc2854-e156-4aff-9b08-b6db30303f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:29 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Volume volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab (a06058db-1baf-4a92-a9bc-eba2c7d83aab): created successfully Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bc2854-e156-4aff-9b08-b6db30303f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:29 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (6fd14cd5-47bb-4755-aca7-0a88ecb77dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:29 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c2b02fca-1a4a-43e2-9b83-bd630c54dd58 tempest-ProjectReaderTests-1529490971 None] Created volume successfully. Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-0bf848d8-5c18-4e75-9749-3c541e423fcd-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-0bf848d8-5c18-4e75-9749-3c541e423fcd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-quobyte-0bf848d8-5c18-4e75-9749-3c541e423fcd" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-0bf848d8-5c18-4e75-9749-3c541e423fcd" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f039085a-06ca-47d0-ac25-56357d7e62ec]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:30 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd Jul 25 02:51:30 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Creating offline snapshot 0ddd8f6a-f635-429c-8186-93234ddde63d of volume a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[92749751-fc42-4bf4-a93d-088cadc376c8]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:30 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab Jul 25 02:51:30 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:30 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd" returned: 0 in 0.506s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:30 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd Jul 25 02:51:30 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:30 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:31 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d 1G Jul 25 02:51:31 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:31 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0bf848d8-5c18-4e75-9749-3c541e423fcd" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-0bf848d8-5c18-4e75-9749-3c541e423fcd" released by "delete_volume" :: held 0.967s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created reservations ['2a570f4e-1271-419b-a5b0-53a2e8934129', '670c2722-2629-4e2a-9fab-56aa7c42b29d', 'efc0dac4-d3a7-4470-bfdd-2198818c5004', '40123813-d5af-4b9d-9e8c-51d5b593e6f1'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:31 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:31 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:31 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d 1G" returned: 0 in 0.621s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:31 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d Jul 25 02:51:31 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:31 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.374s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:31 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Deleted volume successfully. Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c0b6a73d-40f4-4ec2-b299-22dd54fca343 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-0bf848d8-5c18-4e75-9749-3c541e423fcd-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Flow 'volume_create_manager' (26f13853-1641-4a36-aecd-47d553eeb2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9723a29-4301-4da0-ba6a-e94193b8a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9723a29-4301-4da0-ba6a-e94193b8a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1220411534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecac827-494f-43e7-ba48-3f6d5ddbb88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71057d0dfe934330a2e70c8efed11a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:32Z,use_quota=True,user_id='523bc7500e6846b9a41cef1bc0ac6925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547804ce-b22b-4bb7-9bb3-98440c8f7d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547804ce-b22b-4bb7-9bb3-98440c8f7d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352b041a-0beb-42d8-9838-e4d5dd2cd591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352b041a-0beb-42d8-9838-e4d5dd2cd591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecac827-494f-43e7-ba48-3f6d5ddbb88e', 'volume_name': 'volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f011f3f1-dd87-4aa3-8d83-1ed42507e06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f011f3f1-dd87-4aa3-8d83-1ed42507e06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477f104-999c-4061-aa0a-8c8457bf183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:31 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Volume 9ecac827-494f-43e7-ba48-3f6d5ddbb88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e', 'volume_size': 1} Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:31 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d" returned: 0 in 0.357s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:31 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d is being set with open permissions: ugo+rw Jul 25 02:51:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:31 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d Jul 25 02:51:31 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:32 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:32 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info Jul 25 02:51:32 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-c2d11900-ccd4-42d5-b778-d21eb894f14a-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-c2d11900-ccd4-42d5-b778-d21eb894f14a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-quobyte-c2d11900-ccd4-42d5-b778-d21eb894f14a" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-c2d11900-ccd4-42d5-b778-d21eb894f14a" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd9e5e-8114-4802-8994-8e5dee8b5a00]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:32 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info" returned: 0 in 0.332s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:32 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info is being set with open permissions: ugo+rw Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:32 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info Jul 25 02:51:32 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:32 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a Jul 25 02:51:32 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (a19e9c45-318a-4e84-bd63-4438c2a92c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd0b97b-f8fd-4876-b540-30516a6e8d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd0b97b-f8fd-4876-b540-30516a6e8d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592241237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f1005f-814e-4475-962c-28c7a8ab5ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:33Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a58c3a6-1e6b-47e4-9f67-75ab5d08dd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a58c3a6-1e6b-47e4-9f67-75ab5d08dd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803af58f-1bdd-4956-8266-72526a5affe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803af58f-1bdd-4956-8266-72526a5affe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f1005f-814e-4475-962c-28c7a8ab5ab6', 'volume_name': 'volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644039bf-49bf-4162-a48e-e30621e55820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644039bf-49bf-4162-a48e-e30621e55820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a60088-b7c0-441f-bc96-1088d59dea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:32 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Volume a4f1005f-814e-4475-962c-28c7a8ab5ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6', 'volume_size': 1} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:32 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.info" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1220411534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecac827-494f-43e7-ba48-3f6d5ddbb88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71057d0dfe934330a2e70c8efed11a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:32Z,use_quota=True,user_id='523bc7500e6846b9a41cef1bc0ac6925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Creating volume 9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:32 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:32 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e 1073741824 Jul 25 02:51:32 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:32 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c5bf0baf-ec4a-44ac-805f-bf125ce62344 tempest-ProjectReaderTests-1529490971 None] Create snapshot completed successfully Jul 25 02:51:32 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:32 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a Jul 25 02:51:32 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:33 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d11900-ccd4-42d5-b778-d21eb894f14a" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-c2d11900-ccd4-42d5-b778-d21eb894f14a" released by "delete_volume" :: held 0.695s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created reservations ['f1453b55-51ee-4d4b-8799-ef02ae5274cf', 'b18f8741-70c8-464d-acb4-797c60d38cef', 'ba4941de-0e9a-4521-a033-7a451c7fdcd9', '90ebba9b-6cbb-4a3a-816e-6b060e123026'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:33 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e 1073741824" returned: 0 in 0.432s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:33 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:33 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:33 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:33 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:33 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.316s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:33 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.283s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Deleted volume successfully. Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592241237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f1005f-814e-4475-962c-28c7a8ab5ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:33Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Creating volume a4f1005f-814e-4475-962c-28c7a8ab5ab6 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:33 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-quobyte-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:33 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 1073741824 Jul 25 02:51:33 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477f104-999c-4061-aa0a-8c8457bf183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31f1173-09cc-49b4-b0b6-243d73d763b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88" acquired by "delete_volume" :: waited 0.039s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b8a36e68-c2f5-46e1-82f0-035c6593f19f tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-c2d11900-ccd4-42d5-b778-d21eb894f14a-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-0ddd8f6a-f635-429c-8186-93234ddde63d-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:33 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Volume volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e (9ecac827-494f-43e7-ba48-3f6d5ddbb88e): created successfully Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31f1173-09cc-49b4-b0b6-243d73d763b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Flow 'volume_create_manager' (26f13853-1641-4a36-aecd-47d553eeb2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca7e92-ffcc-482e-aa51-def83dc96c47]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-73ae6b1b-a663-4909-8b7b-742bb892ea47 tempest-VolumeDependencyTests-1558465889 None] Created volume successfully. Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-0ddd8f6a-f635-429c-8186-93234ddde63d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-a06058db-1baf-4a92-a9bc-eba2c7d83aab" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-a06058db-1baf-4a92-a9bc-eba2c7d83aab" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-0ddd8f6a-f635-429c-8186-93234ddde63d" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-0ddd8f6a-f635-429c-8186-93234ddde63d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Deleting offline snapshot 0ddd8f6a-f635-429c-8186-93234ddde63d of volume a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] snapshot_file for this snap is: volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[54817691-472b-45d8-a51e-3cc9ece0a7b1]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:33 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 Jul 25 02:51:33 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d Jul 25 02:51:34 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:34 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 1073741824" returned: 0 in 0.566s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:34 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88" returned: 0 in 0.492s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:34 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 Jul 25 02:51:34 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88 Jul 25 02:51:34 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d" returned: 0 in 0.461s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac2be85-6f30-4fbf-b38b-baacb7184b6e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:34 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab Jul 25 02:51:34 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6" returned: 0 in 0.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:34 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88" returned: 0 in 0.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Creating offline snapshot aa8b8fee-5c0d-41af-96f7-1d0c3f478200 of volume 9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88" released by "delete_volume" :: held 0.883s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a60088-b7c0-441f-bc96-1088d59dea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427eb446-b655-477d-82a0-57b41c5cddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1a5d9-3110-4f02-a952-5a54e0b70f9d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:34 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Volume volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 (a4f1005f-814e-4475-962c-28c7a8ab5ab6): created successfully Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427eb446-b655-477d-82a0-57b41c5cddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (a19e9c45-318a-4e84-bd63-4438c2a92c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-40a9592e-b6cc-4f22-a572-b57e0c6051df tempest-ProjectReaderTests-589485506 None] Created volume successfully. Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created reservations ['d1f36283-3e63-45fb-8ca1-c50e20f7d63d', 'ab34a8f6-08ff-4132-974c-340d7e30ed04', '1cc8239e-912e-4dac-92b2-d832d32fce7b', 'a96270f2-0409-4e33-bbf0-b8aca5e2361a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:34 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:34 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab" returned: 0 in 0.408s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:34 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d Jul 25 02:51:34 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:34 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:34 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:35 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:35 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 1G Jul 25 02:51:35 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:35 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:35 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Deleted volume successfully. Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-41271fa9-0fbf-4603-8a43-a7605c4e9f8d tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-91fb996e-f9f4-44b3-bfb0-02f3f6de0a88-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:35 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d" returned: 0 in 0.428s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:35 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d Jul 25 02:51:35 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:35 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 1G" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:35 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 Jul 25 02:51:35 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:35 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab.0ddd8f6a-f635-429c-8186-93234ddde63d" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-0ddd8f6a-f635-429c-8186-93234ddde63d" released by "_delete_snapshot" :: held 1.675s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-a06058db-1baf-4a92-a9bc-eba2c7d83aab" released by "delete_snapshot" :: held 1.704s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Created reservations ['598c6d21-bf5c-4fb4-8250-2c1868b24428', '46bc98b6-47ee-4254-a13a-fb5625235dbf', 'b5fa217a-918d-4a07-b6eb-a714ba3df5dc', '2fdc035b-bd4c-4c86-82fe-9aa3dc69d2f9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:35 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Delete snapshot completed successfully. Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ee6f3f34-f928-431f-ad56-8767ca9f7407 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-0ddd8f6a-f635-429c-8186-93234ddde63d-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:35 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200" returned: 0 in 0.324s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:35 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 is being set with open permissions: ugo+rw Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-0144945f-bf80-45f0-8861-faa4e45eda8d-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:35 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 Jul 25 02:51:35 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-0144945f-bf80-45f0-8861-faa4e45eda8d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-quobyte-0144945f-bf80-45f0-8861-faa4e45eda8d" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-0144945f-bf80-45f0-8861-faa4e45eda8d" acquired by "delete_volume" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e5e38-a6d3-4af4-86ac-189ef07b6ec0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-a06058db-1baf-4a92-a9bc-eba2c7d83aab-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Lock "cinder-a06058db-1baf-4a92-a9bc-eba2c7d83aab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-a4f1005f-814e-4475-962c-28c7a8ab5ab6-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Lock "cinder-a4f1005f-814e-4475-962c-28c7a8ab5ab6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-a06058db-1baf-4a92-a9bc-eba2c7d83aab" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-a06058db-1baf-4a92-a9bc-eba2c7d83aab" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:36 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d Jul 25 02:51:36 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-quobyte-a4f1005f-814e-4475-962c-28c7a8ab5ab6" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200" returned: 0 in 0.384s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e1ffe-a9bf-4618-9141-43fbc3f85515]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-a4f1005f-814e-4475-962c-28c7a8ab5ab6" acquired by "delete_volume" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ee22a-ea3d-402c-8126-e0f92e850ef7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab Jul 25 02:51:36 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info Jul 25 02:51:36 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 Jul 25 02:51:36 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d" returned: 0 in 0.472s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d Jul 25 02:51:36 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info" returned: 0 in 0.295s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info is being set with open permissions: ugo+rw Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab" returned: 0 in 0.414s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info Jul 25 02:51:36 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab Jul 25 02:51:36 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6" returned: 0 in 0.409s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6 Jul 25 02:51:36 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-0144945f-bf80-45f0-8861-faa4e45eda8d" returned: 0 in 0.277s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-0144945f-bf80-45f0-8861-faa4e45eda8d" released by "delete_volume" :: held 0.805s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created reservations ['03497516-ff1b-426c-8d9c-2440961c27c1', 'ba708749-5300-4ffd-9267-1b39fb9844a1', 'e8bf528e-fca8-4819-a661-f65c1e8d54c4', 'bb20fa5e-d782-4c7f-88a5-f1e3c6a04bdf'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:36 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.info" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:36 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a06058db-1baf-4a92-a9bc-eba2c7d83aab" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:36 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-a06058db-1baf-4a92-a9bc-eba2c7d83aab" released by "delete_volume" :: held 0.796s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:36 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f2a8a150-6212-40f8-84b6-e2a2695b3348 tempest-VolumeDependencyTests-1558465889 None] Create snapshot completed successfully Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-a4f1005f-814e-4475-962c-28c7a8ab5ab6" returned: 0 in 0.289s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:36 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-a4f1005f-814e-4475-962c-28c7a8ab5ab6" released by "delete_volume" :: held 0.754s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Created reservations ['eb86def8-0312-48c6-90c5-363094ff1f64', '0cb6368a-328e-4700-b862-ef02913b1700', '80a2ca96-1660-44f6-926b-174a95eb05a1', 'aae6b234-4c37-4e19-859a-f13b18ba40ca'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-15e291be-31e6-4f2a-964f-124a054ecb88-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Created reservations ['358ea989-0285-4e73-808a-69833f4e7190', 'a3d832a2-e18e-4b5e-a451-2169440ccd58', '07aab19e-6d35-4ee4-9c24-425649781a0e', 'b39f3fd1-6d62-45c3-85a7-ee3180f76caf'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-15e291be-31e6-4f2a-964f-124a054ecb88-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:37 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:37 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-quobyte-15e291be-31e6-4f2a-964f-124a054ecb88" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:37 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.348s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-15e291be-31e6-4f2a-964f-124a054ecb88" acquired by "delete_volume" :: waited 0.063s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:37 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:37 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Deleted volume successfully. Jul 25 02:51:37 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e36f0b-78ee-4891-ba4f-b5a2f2c4977f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a5951bab-6288-4635-a733-7f5698e5fa41 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-0144945f-bf80-45f0-8861-faa4e45eda8d-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:37 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 Jul 25 02:51:37 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:37 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.350s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:37 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Deleted volume successfully. Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ba823175-e47f-4f7b-8ee5-974f500f232b tempest-ProjectReaderTests-1529490971 None] Lock "cinder-a06058db-1baf-4a92-a9bc-eba2c7d83aab-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:37 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.494s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:37 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Deleted volume successfully. Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-3ec75f4d-0d64-4052-84c5-5f240dc3a87b tempest-ProjectReaderTests-589485506 None] Lock "cinder-a4f1005f-814e-4475-962c-28c7a8ab5ab6-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:37 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88" returned: 0 in 0.516s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:37 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88 Jul 25 02:51:37 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (2c20de58-6e84-475c-ada4-3d5cb8eb5462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7a97a8-fbcd-41b5-93f8-9cb4974f4869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7a97a8-fbcd-41b5-93f8-9cb4974f4869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972616588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bcba45-bf4f-485b-92b6-088dd080228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:38Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168a0860-1b22-40f8-903d-25c16484c23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168a0860-1b22-40f8-903d-25c16484c23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeeb0a53-98ba-4514-8aea-84fb4df33936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeeb0a53-98ba-4514-8aea-84fb4df33936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49bcba45-bf4f-485b-92b6-088dd080228d', 'volume_name': 'volume-49bcba45-bf4f-485b-92b6-088dd080228d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfecf4d-d98d-4212-b874-6f59a8d75986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfecf4d-d98d-4212-b874-6f59a8d75986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9207af2-8e88-4ac8-af1c-0b89c0f6f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Volume 49bcba45-bf4f-485b-92b6-088dd080228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49bcba45-bf4f-485b-92b6-088dd080228d', 'volume_size': 1} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972616588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bcba45-bf4f-485b-92b6-088dd080228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:38Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Creating volume 49bcba45-bf4f-485b-92b6-088dd080228d {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:38 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:38 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15e291be-31e6-4f2a-964f-124a054ecb88" returned: 0 in 0.490s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:38 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d 1073741824 Jul 25 02:51:38 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-15e291be-31e6-4f2a-964f-124a054ecb88" released by "delete_volume" :: held 1.088s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (ea277369-0df2-44df-b773-307ae2a8d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0416e38d-70e9-4f07-825c-fb1d237b6602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0416e38d-70e9-4f07-825c-fb1d237b6602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551632658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:38Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d277501f-d799-4c30-bb4d-ed5b89a8264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d277501f-d799-4c30-bb4d-ed5b89a8264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881d9042-8b5b-4146-b68e-80b5018edea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881d9042-8b5b-4146-b68e-80b5018edea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673', 'volume_name': 'volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5136fea6-4336-4c98-889b-e311f28ef3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5136fea6-4336-4c98-889b-e311f28ef3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac28646-2a63-4d2b-be8d-9f8c96cda771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Volume 8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673', 'volume_size': 1} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created reservations ['76269092-8e41-42b0-abd6-265ee334ddb4', 'b77b2f3a-3be2-480d-879e-df6744ab8ab3', 'a49a4e05-d0f4-4a0d-a7ce-cd6065345c0b', 'bbe13e24-0b84-480f-a1c8-df8969661e3a'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Flow 'volume_create_manager' (ec309698-1cdc-4352-8c1f-0aaa45d99d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8467dd8c-def4-4a72-bb1d-6979ab07bf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8467dd8c-def4-4a72-bb1d-6979ab07bf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502494955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc0dbec-0cb2-4f27-84f8-16b0bd99414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71057d0dfe934330a2e70c8efed11a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa8b8fee-5c0d-41af-96f7-1d0c3f478200,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:39Z,use_quota=True,user_id='523bc7500e6846b9a41cef1bc0ac6925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850c0bea-fc54-43e4-a968-7f63d7b9ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850c0bea-fc54-43e4-a968-7f63d7b9ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5836b60e-0d49-4cdf-b80c-117c24bc2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5836b60e-0d49-4cdf-b80c-117c24bc2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dbc0dbec-0cb2-4f27-84f8-16b0bd99414b', 'volume_name': 'volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b', 'volume_size': 1, 'snapshot_id': 'aa8b8fee-5c0d-41af-96f7-1d0c3f478200'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e63498c-d0f6-4fb9-b3eb-f4c9232b5884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e63498c-d0f6-4fb9-b3eb-f4c9232b5884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe07f41-2f73-4dad-beda-b3eec562209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:38 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Volume dbc0dbec-0cb2-4f27-84f8-16b0bd99414b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b', 'volume_size': 1, 'snapshot_id': 'aa8b8fee-5c0d-41af-96f7-1d0c3f478200'} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:38 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:38 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:38 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d 1073741824" returned: 0 in 0.620s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:38 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d Jul 25 02:51:38 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:38 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:38 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Deleted volume successfully. Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-0c323c99-0d57-425e-ac1e-9adf241bda20 tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-15e291be-31e6-4f2a-964f-124a054ecb88-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:39 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551632658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:38Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Creating volume 8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:39 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9207af2-8e88-4ac8-af1c-0b89c0f6f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bcba45-bf4f-485b-92b6-088dd080228d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:39 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 1073741824 Jul 25 02:51:39 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36733e92-4f12-4d07-b372-08df85b6d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:39 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Volume volume-49bcba45-bf4f-485b-92b6-088dd080228d (49bcba45-bf4f-485b-92b6-088dd080228d): created successfully Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36733e92-4f12-4d07-b372-08df85b6d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (2c20de58-6e84-475c-ada4-3d5cb8eb5462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:39 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-260bbe9c-003e-4627-ad1d-898aa1bf0bd2 tempest-ProjectReaderTests-589485506 None] Created volume successfully. Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-b7e3763a-2cce-47ad-9f5d-56907734e783-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-b7e3763a-2cce-47ad-9f5d-56907734e783-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "cinder-quobyte-b7e3763a-2cce-47ad-9f5d-56907734e783" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-b7e3763a-2cce-47ad-9f5d-56907734e783" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[366acdd6-cce2-4493-9b5d-7e9d8c4dc25c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:39 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 Jul 25 02:51:39 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:39 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 1073741824" returned: 0 in 0.499s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:39 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 Jul 25 02:51:39 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:39 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783" returned: 0 in 0.404s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:39 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783 Jul 25 02:51:39 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:40 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.277s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-quobyte-aa8b8fee-5c0d-41af-96f7-1d0c3f478200-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac28646-2a63-4d2b-be8d-9f8c96cda771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0ee81f-51e0-4e7c-b577-aebe00542ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-49bcba45-bf4f-485b-92b6-088dd080228d-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-aa8b8fee-5c0d-41af-96f7-1d0c3f478200-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Creating volume dbc0dbec-0cb2-4f27-84f8-16b0bd99414b from snapshot aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-quobyte-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:40 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Volume volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 (8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673): created successfully Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0ee81f-51e0-4e7c-b577-aebe00542ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:40 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (ea277369-0df2-44df-b773-307ae2a8d35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Lock "cinder-49bcba45-bf4f-485b-92b6-088dd080228d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-b7e3763a-2cce-47ad-9f5d-56907734e783" returned: 0 in 0.306s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] snapshot: aa8b8fee-5c0d-41af-96f7-1d0c3f478200, volume: dbc0dbec-0cb2-4f27-84f8-16b0bd99414b, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:51:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a681e35e-8af5-4da9-9e2a-adb5aa15fbdd tempest-ProjectReaderTests-1529490971 None] Created volume successfully. Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-quobyte-b7e3763a-2cce-47ad-9f5d-56907734e783" released by "delete_volume" :: held 0.766s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[595254dc-4df6-4a6f-94db-273f012637cb]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-quobyte-49bcba45-bf4f-485b-92b6-088dd080228d" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-49bcba45-bf4f-485b-92b6-088dd080228d" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b547c1-c621-479f-a7e7-c2727f593cac]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Created reservations ['65265e7b-b237-4b41-9c0e-62afdfec8118', 'b5c4b9ea-4af8-4bad-8bef-b8ac246702e0', '960f9463-009d-48a1-8fef-93eccbd03448', 'c85be007-4316-4016-bf93-c3c7ad9a59e2'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:40 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 Jul 25 02:51:40 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:40 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d Jul 25 02:51:40 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:40 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:40 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:40 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200" returned: 0 in 0.457s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:51:40 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d" returned: 0 in 0.403s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13818f-207c-46c5-bc0d-025fb759d1a5]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:40 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d Jul 25 02:51:40 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:40 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:40 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Deleted volume successfully. Jul 25 02:51:40 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91d76463-116f-41c5-9ffc-2b4b8a55e84c tempest-CreateVolumesFromSourceVolumeTest-1951626610 None] Lock "cinder-b7e3763a-2cce-47ad-9f5d-56907734e783-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:40 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:40 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:41 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-49bcba45-bf4f-485b-92b6-088dd080228d" returned: 0 in 0.309s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-49bcba45-bf4f-485b-92b6-088dd080228d" released by "delete_volume" :: held 0.764s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Created reservations ['032f9b83-885f-47a2-98ef-7d016b5d875a', '61396dfd-cb7d-4f66-bdf2-e9ee81689dca', '9d6c9fd3-a9f5-4def-8217-854bb1a651b9', 'f7d9e84b-3b35-402b-93af-311b50c068ac'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:41 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.434s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:41 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b Jul 25 02:51:41 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:41 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:41 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:41 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.396s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Deleted volume successfully. Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-acabe8ad-1f9f-4f1c-a18f-700a96367b0c tempest-ProjectReaderTests-589485506 None] Lock "cinder-49bcba45-bf4f-485b-92b6-088dd080228d-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:41 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (4214c562-b23d-4913-89bf-3123f217f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ee9f06-5b80-4857-a56b-af324b047ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ee9f06-5b80-4857-a56b-af324b047ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394209762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2494b32a-df71-4e7d-9e9d-09831e4abcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:42Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24496a9-02c3-4a14-80e4-9f5f94260e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24496a9-02c3-4a14-80e4-9f5f94260e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116a3e25-2773-439e-93f9-39b8a72f37b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116a3e25-2773-439e-93f9-39b8a72f37b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2494b32a-df71-4e7d-9e9d-09831e4abcbb', 'volume_name': 'volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3306e640-54c4-47bc-ad6f-a7818dd1aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3306e640-54c4-47bc-ad6f-a7818dd1aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678f7209-e4b0-4c1f-97fd-cdc828f3b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:42 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Volume 2494b32a-df71-4e7d-9e9d-09831e4abcbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb', 'volume_size': 1} Jul 25 02:51:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:46 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" returned: 0 in 4.951s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4369cc80-4524-4dc4-9ed8-d78fd67cc587]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:46 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:46 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:46 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.560s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:51:46 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Converted 1024.00 MB image at 206.77 MB/s Jul 25 02:51:46 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b is being set with open permissions: ugo+rw Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:46 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b Jul 25 02:51:46 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:46 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" released by "_copy_volume_from_snapshot" :: held 6.827s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-aa8b8fee-5c0d-41af-96f7-1d0c3f478200-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" released by "_create_volume_from_snapshot" :: held 6.891s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.943s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.498s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Creating offline snapshot 45ce5f3e-2220-46f8-8ef3-e693433b9e90 of volume 8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe07f41-2f73-4dad-beda-b3eec562209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b', 'volume_size': 1, 'snapshot_id': 'aa8b8fee-5c0d-41af-96f7-1d0c3f478200'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ec287e-1c44-4578-af30-5e54af13470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7ed2f-83a1-4b34-9fc8-c3dadacbdd71]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:47 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Volume volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b (dbc0dbec-0cb2-4f27-84f8-16b0bd99414b): created successfully Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ec287e-1c44-4578-af30-5e54af13470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Flow 'volume_create_manager' (ec309698-1cdc-4352-8c1f-0aaa45d99d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:47 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-626d62a4-fd33-4bbb-adcb-b81dd3534a3e tempest-VolumeDependencyTests-1558465889 None] Created volume successfully. Jul 25 02:51:47 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 Jul 25 02:51:47 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:47 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" returned: 0 in 0.396s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-aa8b8fee-5c0d-41af-96f7-1d0c3f478200-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:47 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 1G Jul 25 02:51:47 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-aa8b8fee-5c0d-41af-96f7-1d0c3f478200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-quobyte-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-quobyte-aa8b8fee-5c0d-41af-96f7-1d0c3f478200" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-aa8b8fee-5c0d-41af-96f7-1d0c3f478200" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Deleting offline snapshot aa8b8fee-5c0d-41af-96f7-1d0c3f478200 of volume 9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] snapshot_file for this snap is: volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7afae3-c738-4aa3-bfef-ff802daf55d7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:47 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 Jul 25 02:51:47 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:47 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 1G" returned: 0 in 0.527s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:47 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 Jul 25 02:51:47 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:47 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200" returned: 0 in 0.415s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:47 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f953a7fd-5ae9-47f1-84d0-9330b4b14903]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:48 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:48 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:48 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90" returned: 0 in 0.326s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:48 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 is being set with open permissions: ugo+rw Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:48 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 Jul 25 02:51:48 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:48 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.394s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:48 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 Jul 25 02:51:48 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:48 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90" returned: 0 in 0.302s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:48 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info Jul 25 02:51:48 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Flow 'volume_create_manager' (070146b2-102d-460e-af34-7e4f7671bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e39ea9-40e3-42db-9a68-6b7cc8ecbdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e39ea9-40e3-42db-9a68-6b7cc8ecbdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d39f4e-43d3-4849-af91-2c7500972629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792b3213f58a419d8e535913decd8acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:49Z,use_quota=True,user_id='3dfb4681807d4c87b04240b10de45310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a15960e-5622-48e0-ac25-7b3fd9e56ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a15960e-5622-48e0-ac25-7b3fd9e56ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba17f1c-8ea5-41e2-a29b-1cfb2638e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG cinder.image.glance [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Creating Keystone auth plugin from conf {{(pid=88279) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 25 02:51:48 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:48 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200 Jul 25 02:51:48 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:48 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info" returned: 0 in 0.301s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:48 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info is being set with open permissions: ugo+rw Jul 25 02:51:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:48 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info Jul 25 02:51:48 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba17f1c-8ea5-41e2-a29b-1cfb2638e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2d39f4e-43d3-4849-af91-2c7500972629', 'volume_name': 'volume-c2d39f4e-43d3-4849-af91-2c7500972629', 'volume_size': 1, 'image_id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4392288d-77c0-4f01-b88b-a43b861e1338', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e8fa877cce483355085aa560bbb32ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '792b3213f58a419d8e535913decd8acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee39a0c9b6e23285f571b1bd79f999416b0e6eb3477845389c983230b5db977a68d6cb04cd6ab325bc6298ac3b8a2d89eaabdacf7e499ee4dd7291611ba92f8b', 'id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'created_at': datetime.datetime(2026, 7, 25, 0, 51, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 51, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4392288d-77c0-4f01-b88b-a43b861e1338/file', 'properties': {}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca03f04-7c59-45f7-9e2d-6e35abbf702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca03f04-7c59-45f7-9e2d-6e35abbf702b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdbc109-fcac-4fb3-bad7-2a98aba31add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:49 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Volume c2d39f4e-43d3-4849-af91-2c7500972629: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2d39f4e-43d3-4849-af91-2c7500972629', 'volume_size': 1, 'image_id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4392288d-77c0-4f01-b88b-a43b861e1338', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e8fa877cce483355085aa560bbb32ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '792b3213f58a419d8e535913decd8acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee39a0c9b6e23285f571b1bd79f999416b0e6eb3477845389c983230b5db977a68d6cb04cd6ab325bc6298ac3b8a2d89eaabdacf7e499ee4dd7291611ba92f8b', 'id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'created_at': datetime.datetime(2026, 7, 25, 0, 51, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 51, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4392288d-77c0-4f01-b88b-a43b861e1338/file', 'properties': {}}, 'image_service': } Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Trying to clone c2d39f4e-43d3-4849-af91-2c7500972629 from image 4392288d-77c0-4f01-b88b-a43b861e1338 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4392288d-77c0-4f01-b88b-a43b861e1338', 'metadata': {}}]). {{(pid=88279) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 25 02:51:49 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e.aa8b8fee-5c0d-41af-96f7-1d0c3f478200" returned: 0 in 0.274s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:49 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.info" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-aa8b8fee-5c0d-41af-96f7-1d0c3f478200" released by "_delete_snapshot" :: held 1.673s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 25 02:51:49 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Image download 0.00 MB at 0.00 MB/s Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.078s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394209762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2494b32a-df71-4e7d-9e9d-09831e4abcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:42Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Creating volume 2494b32a-df71-4e7d-9e9d-09831e4abcbb {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:49 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" released by "delete_snapshot" :: held 1.740s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:49 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb 1073741824 Jul 25 02:51:49 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:49 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-0a89c283-8196-466c-8d06-298da628f85f tempest-ProjectReaderTests-1529490971 None] Create snapshot completed successfully Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e96adcb-53ec-4925-9ca0-ef918827f0ea]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Created reservations ['50eb8eb6-c165-4ad3-84f4-87ddd79ca7ee', 'eba26a5b-3a70-472d-8086-845af39eb05d', '5b8bfc5b-ce71-43ca-be91-9e74afd64429', '7b68b4cc-f361-45d2-b4f3-a0074d05f776'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:49 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Delete snapshot completed successfully. Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-b36b33d1-9dbb-4843-8723-75a5b3ab40ce tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-aa8b8fee-5c0d-41af-96f7-1d0c3f478200-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:49 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD Jul 25 02:51:49 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:49 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-9ecac827-494f-43e7-ba48-3f6d5ddbb88e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-9ecac827-494f-43e7-ba48-3f6d5ddbb88e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-quobyte-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" acquired by "delete_volume" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:49 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb 1073741824" returned: 0 in 0.612s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:49 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD Jul 25 02:51:49 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e83e08-6af3-4a17-8a85-7f6ef44ffb2e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:49 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb Jul 25 02:51:49 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:49 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:49 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-45ce5f3e-2220-46f8-8ef3-e693433b9e90-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Lock "cinder-45ce5f3e-2220-46f8-8ef3-e693433b9e90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-45ce5f3e-2220-46f8-8ef3-e693433b9e90" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-45ce5f3e-2220-46f8-8ef3-e693433b9e90" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Deleting offline snapshot 45ce5f3e-2220-46f8-8ef3-e693433b9e90 of volume 8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:51:50 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] snapshot_file for this snap is: volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Temporary image 4392288d-77c0-4f01-b88b-a43b861e1338 is fetched for user 3dfb4681807d4c87b04240b10de45310. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2d7a32-3d32-4dac-a9a4-0dfdc058d613]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff0e13-469b-4d2d-8474-5f1bfa733740]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb" returned: 0 in 0.347s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678f7209-e4b0-4c1f-97fd-cdc828f3b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:50 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 Jul 25 02:51:50 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ef9a0f-05af-4612-9ad2-3741b639fdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:50 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Volume volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb (2494b32a-df71-4e7d-9e9d-09831e4abcbb): created successfully Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ef9a0f-05af-4612-9ad2-3741b639fdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (4214c562-b23d-4913-89bf-3123f217f016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:50 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-61946b87-2657-4b4b-ad1b-66cdf5779d26 tempest-ProjectReaderTests-589485506 None] Created volume successfully. Jul 25 02:51:50 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.468s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD Jul 25 02:51:50 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e Jul 25 02:51:50 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90" returned: 0 in 0.429s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:51:50 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50c6a69-51d3-4122-b24b-a0b0aad1ec01]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" returned: 0 in 0.282s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-9ecac827-494f-43e7-ba48-3f6d5ddbb88e" released by "delete_volume" :: held 0.825s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Created reservations ['a2e26882-6f21-4b46-8c76-0a616a8c1cb0', '30f71d6f-c939-4a92-9783-50e9ea8b6031', '8eb8812c-b028-45af-a2c2-bae917557eb2', '9f7941fb-7411-46b5-ab44-e74e866cb49b'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:50 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD Jul 25 02:51:50 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 Jul 25 02:51:50 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:50 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:50 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:50 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:50 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:51 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d39f4e-43d3-4849-af91-2c7500972629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792b3213f58a419d8e535913decd8acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:49Z,use_quota=True,user_id='3dfb4681807d4c87b04240b10de45310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Creating volume c2d39f4e-43d3-4849-af91-2c7500972629 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:51 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-2494b32a-df71-4e7d-9e9d-09831e4abcbb-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:51 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 1073741824 Jul 25 02:51:51 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Lock "cinder-2494b32a-df71-4e7d-9e9d-09831e4abcbb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" returned: 0 in 0.574s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.381s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 Jul 25 02:51:51 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "cinder-quobyte-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:51 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.470s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-quobyte-2494b32a-df71-4e7d-9e9d-09831e4abcbb" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:51 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Deleted volume successfully. Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" acquired by "delete_volume" :: waited 0.035s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8cd29c7d-7bce-4b58-8fff-f53b1ded0014 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-9ecac827-494f-43e7-ba48-3f6d5ddbb88e-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-2494b32a-df71-4e7d-9e9d-09831e4abcbb" acquired by "delete_volume" :: waited 0.049s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d202c82d-273d-4016-b058-82f9953bfd2c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f49680a-7e31-4d7b-b6d1-c45206ea9123]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b Jul 25 02:51:51 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb Jul 25 02:51:51 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90 Jul 25 02:51:51 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 1073741824" returned: 0 in 0.576s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 Jul 25 02:51:51 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb" returned: 0 in 0.429s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:51 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b Jul 25 02:51:51 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb Jul 25 02:51:51 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:51 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673.45ce5f3e-2220-46f8-8ef3-e693433b9e90" returned: 0 in 0.329s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-45ce5f3e-2220-46f8-8ef3-e693433b9e90" released by "_delete_snapshot" :: held 1.869s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" released by "delete_snapshot" :: held 1.901s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:51 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629" returned: 0 in 0.332s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:52 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" returned: 0 in 0.304s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:52 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Attempting download of 4392288d-77c0-4f01-b88b-a43b861e1338 ((None, [{'url': 'file:///opt/stack/data/glance/images/4392288d-77c0-4f01-b88b-a43b861e1338', 'metadata': {}}])) to volume c2d39f4e-43d3-4849-af91-2c7500972629. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-quobyte-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b" released by "delete_volume" :: held 0.804s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-2494b32a-df71-4e7d-9e9d-09831e4abcbb" returned: 0 in 0.315s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-2494b32a-df71-4e7d-9e9d-09831e4abcbb" released by "delete_volume" :: held 0.794s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Created reservations ['89650ed0-7310-46a4-b492-0337fdae7e52', '86929730-85ec-42d3-a25c-3e00c099d91a', '5c490f36-2126-4477-958e-4585c2ee411f', '047e6566-79a5-4cc0-8f42-35c0f870b45e'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74dfcfd-5565-4ef7-b3e4-6f78c9164ade]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Created reservations ['ad7ab393-c8ee-4902-b65b-9b1c28d3f238', '29f57521-85da-46e7-84bb-6d7f58b6a414', '8ad541a1-8e5f-4089-8c7f-a1c81920bbda', '6648c5fe-b689-4425-ab9f-1afc739b57b7'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Created reservations ['e6efb6da-ca1d-4511-8d0b-23555aad5a30', 'ebba2946-faa6-495b-a7a1-41f6b0fe35a2', 'cf21e690-3328-422c-b6b2-00387dc4a210', 'fbbaf2c0-2b21-4b86-af23-a08271a212ce'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Delete snapshot completed successfully. Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-dffc5d90-b74f-482e-a026-581691f406af tempest-ProjectReaderTests-1529490971 None] Lock "cinder-45ce5f3e-2220-46f8-8ef3-e693433b9e90-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:52 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv Jul 25 02:51:52 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:52 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:52 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:52 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:52 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:52 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv" returned: 0 in 0.365s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:52 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.267s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Deleted volume successfully. Jul 25 02:51:52 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:52 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv Jul 25 02:51:52 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.264s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-83f6620f-b3e0-413e-a8dd-a3927e666c26 tempest-VolumeDependencyTests-1558465889 None] Lock "cinder-dbc0dbec-0cb2-4f27-84f8-16b0bd99414b-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:52 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Deleted volume successfully. Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-47fa7b2c-918b-46ed-a67a-a447bdb4907f tempest-ProjectReaderTests-589485506 None] Lock "cinder-2494b32a-df71-4e7d-9e9d-09831e4abcbb-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:52 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv" returned: 1 in 0.336s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4392288d-77c0-4f01-b88b-a43b861e1338__55da2lv' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2715dd0c-b974-4859-9053-22a6136f79f8]: (4, 'raw') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:52 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD Jul 25 02:51:52 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:53 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:53 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD Jul 25 02:51:53 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a92d40-dcd7-4019-9abd-86af7ef8ebbb]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:53 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] 4392288d-77c0-4f01-b88b-a43b861e1338 was raw, converting to qcow2 {{(pid=88279) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:53 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 Jul 25 02:51:53 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:53 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 Jul 25 02:51:53 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:53 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" returned: 0 in 0.480s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:54 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673 Jul 25 02:51:54 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (21b69ee6-d6ff-48b8-a209-108cb58100eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ffd4d-f814-43e1-aa9d-82875e21890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ffd4d-f814-43e1-aa9d-82875e21890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328839407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cd467b-c137-4ec8-91b5-3fbe2bc4f339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:54Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ed2f5-fcf4-4d1b-a909-41371b9af230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ed2f5-fcf4-4d1b-a909-41371b9af230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b915c1-be7a-4497-975c-d2cb631a55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b915c1-be7a-4497-975c-d2cb631a55fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63cd467b-c137-4ec8-91b5-3fbe2bc4f339', 'volume_name': 'volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4890c395-67c8-4b89-bb51-54781dc164b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4890c395-67c8-4b89-bb51-54781dc164b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f27dc1d-1780-4b45-9abb-a344a414cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:54 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Volume 63cd467b-c137-4ec8-91b5-3fbe2bc4f339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339', 'volume_size': 1} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328839407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cd467b-c137-4ec8-91b5-3fbe2bc4f339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f26be2f348c4709a8957e31281cec59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:54Z,use_quota=True,user_id='83ace9276c524c629c0890bf470bfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Creating volume 63cd467b-c137-4ec8-91b5-3fbe2bc4f339 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:54 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:54 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629" returned: 0 in 0.623s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4392288d-77c0-4f01-b88b-a43b861e1338_l9zjweyldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:51:54 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Converted 0.00 MB image at 0.00 MB/s Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:54 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 1073741824 Jul 25 02:51:54 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:54 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 1G Jul 25 02:51:54 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:54 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" returned: 0 in 0.292s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673" released by "delete_volume" :: held 0.879s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Created reservations ['c209612c-5c18-4479-888e-d4eadfa5ff4e', '181c7423-ff14-489a-95e9-e0faca793175', '1161b7d3-86ef-4396-8696-68ad0962dfc3', '9cf2729c-9761-41f2-9c81-ab4fcaf95f29'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:54 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:54 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:54 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 1G" returned: 0 in 0.441s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Downloaded image 4392288d-77c0-4f01-b88b-a43b861e1338 ((None, [{'url': 'file:///opt/stack/data/glance/images/4392288d-77c0-4f01-b88b-a43b861e1338', 'metadata': {}}])) to volume c2d39f4e-43d3-4849-af91-2c7500972629 successfully. {{(pid=88279) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Temporary image 4392288d-77c0-4f01-b88b-a43b861e1338 for user 3dfb4681807d4c87b04240b10de45310 is deleted. {{(pid=88279) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.volume_utils [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Marking volume c2d39f4e-43d3-4849-af91-2c7500972629 as bootable. {{(pid=88279) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Copying metadata from image 4392288d-77c0-4f01-b88b-a43b861e1338 to c2d39f4e-43d3-4849-af91-2c7500972629. {{(pid=88279) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Creating volume glance metadata for volume c2d39f4e-43d3-4849-af91-2c7500972629 backed by image 4392288d-77c0-4f01-b88b-a43b861e1338 with: {'image_id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4e8fa877cce483355085aa560bbb32ec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88279) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 25 02:51:54 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 1073741824" returned: 0 in 0.586s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdbc109-fcac-4fb3-bad7-2a98aba31add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d39f4e-43d3-4849-af91-2c7500972629', 'volume_size': 1, 'image_id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4392288d-77c0-4f01-b88b-a43b861e1338', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e8fa877cce483355085aa560bbb32ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '792b3213f58a419d8e535913decd8acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee39a0c9b6e23285f571b1bd79f999416b0e6eb3477845389c983230b5db977a68d6cb04cd6ab325bc6298ac3b8a2d89eaabdacf7e499ee4dd7291611ba92f8b', 'id': '4392288d-77c0-4f01-b88b-a43b861e1338', 'created_at': datetime.datetime(2026, 7, 25, 0, 51, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 25, 0, 51, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4392288d-77c0-4f01-b88b-a43b861e1338/file', 'properties': {}}, 'image_service': }' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dc4360-f421-4d07-9206-6d5c8eca8d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:54 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Volume volume-c2d39f4e-43d3-4849-af91-2c7500972629 (c2d39f4e-43d3-4849-af91-2c7500972629): created successfully Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dc4360-f421-4d07-9206-6d5c8eca8d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Flow 'volume_create_manager' (070146b2-102d-460e-af34-7e4f7671bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:54 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6977ec95-f6bb-4d66-9785-f3cb72f3e800 tempest-VolumeImageDependencyTests-950354886 None] Created volume successfully. Jul 25 02:51:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Deleted volume successfully. Jul 25 02:51:54 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 Jul 25 02:51:54 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-1d6b34da-774b-47e4-9789-e0e2fdfe5568 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-8d81b2f9-ad45-4ad5-a7f5-5bf203b3f673-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:55 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (fceb7427-7da5-485f-bdc4-c720ccacfc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec92f55-6330-4d5d-a408-420c9c6e613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f27dc1d-1780-4b45-9abb-a344a414cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fc5c82-8161-4075-a548-8c727a632492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Acquiring lock "cinder-c2d39f4e-43d3-4849-af91-2c7500972629-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec92f55-6330-4d5d-a408-420c9c6e613f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923479053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829fedd1-5349-4944-b2c6-e65f77b64112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:55Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24abe287-83fa-4ecb-9fc1-db1a8c657e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24abe287-83fa-4ecb-9fc1-db1a8c657e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7953cf84-8aa0-4e45-ae9d-87d334d5d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7953cf84-8aa0-4e45-ae9d-87d334d5d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829fedd1-5349-4944-b2c6-e65f77b64112', 'volume_name': 'volume-829fedd1-5349-4944-b2c6-e65f77b64112', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7e9e8b-6bd5-47fa-bb91-d616611093b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7e9e8b-6bd5-47fa-bb91-d616611093b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3124c3-3f02-4be5-a0a5-4acb1c31a790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Volume 829fedd1-5349-4944-b2c6-e65f77b64112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829fedd1-5349-4944-b2c6-e65f77b64112', 'volume_size': 1} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923479053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829fedd1-5349-4944-b2c6-e65f77b64112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:55Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Creating volume 829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:55 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Volume volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 (63cd467b-c137-4ec8-91b5-3fbe2bc4f339): created successfully Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fc5c82-8161-4075-a548-8c727a632492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:55 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 1073741824 Jul 25 02:51:55 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Flow 'volume_create_manager' (21b69ee6-d6ff-48b8-a209-108cb58100eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Lock "cinder-c2d39f4e-43d3-4849-af91-2c7500972629-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:55 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b9b62874-8e50-453a-b664-0432eb91d514 tempest-ProjectReaderTests-589485506 None] Created volume successfully. Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Acquiring lock "cinder-quobyte-c2d39f4e-43d3-4849-af91-2c7500972629" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Lock "cinder-quobyte-c2d39f4e-43d3-4849-af91-2c7500972629" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa07fbd4-9fb5-4b81-a73b-07721e05d3f6]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:55 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 Jul 25 02:51:55 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:55 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 1073741824" returned: 0 in 0.515s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:55 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629" returned: 0 in 0.422s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:55 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 Jul 25 02:51:55 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:55 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629 Jul 25 02:51:55 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:56 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-63cd467b-c137-4ec8-91b5-3fbe2bc4f339-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:56 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112" returned: 0 in 0.318s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=254,cinder:UPDATE=349,cinder:INSERT=95,cinder:DELETE=34 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c2d39f4e-43d3-4849-af91-2c7500972629" returned: 0 in 0.322s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Lock "cinder-63cd467b-c137-4ec8-91b5-3fbe2bc4f339-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3124c3-3f02-4be5-a0a5-4acb1c31a790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829fedd1-5349-4944-b2c6-e65f77b64112', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e76ada-0353-41c4-a0a2-a8ac83a11ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=358,cinder:SELECT=255,cinder:INSERT=91,cinder:DELETE=29 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Lock "cinder-quobyte-c2d39f4e-43d3-4849-af91-2c7500972629" released by "delete_volume" :: held 0.825s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:56 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Volume volume-829fedd1-5349-4944-b2c6-e65f77b64112 (829fedd1-5349-4944-b2c6-e65f77b64112): created successfully Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e76ada-0353-41c4-a0a2-a8ac83a11ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (fceb7427-7da5-485f-bdc4-c720ccacfc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8ec5234b-cc4b-4bf2-951f-b0f0b82e4090 tempest-ProjectReaderTests-1529490971 None] Created volume successfully. Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Acquiring lock "cinder-quobyte-63cd467b-c137-4ec8-91b5-3fbe2bc4f339" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-63cd467b-c137-4ec8-91b5-3fbe2bc4f339" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9559757-f627-444d-a104-214df45f5e37]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Created reservations ['21c2c883-4e7a-4332-a4c6-17c1626010c9', '4766a0f1-9365-46a1-8a5f-4a582199d207', '68af9e5c-897c-45a4-a0ed-02ef2ab4fe8d', '6940e28b-4952-4993-8805-8e56cdaa0b49'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:56 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:56 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:56 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 Jul 25 02:51:56 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:56 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Deleted volume successfully. Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-19b461a9-cb77-4c90-b25a-747d969aed8f tempest-VolumeImageDependencyTests-950354886 None] Lock "cinder-c2d39f4e-43d3-4849-af91-2c7500972629-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:56 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339" returned: 0 in 0.433s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:56 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339 Jul 25 02:51:56 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:57 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-63cd467b-c137-4ec8-91b5-3fbe2bc4f339" returned: 0 in 0.260s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Lock "cinder-quobyte-63cd467b-c137-4ec8-91b5-3fbe2bc4f339" released by "delete_volume" :: held 0.745s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Flow 'volume_create_manager' (e315e4ad-4737-4fd9-89ae-c1899d2e691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa554be-b406-4bc4-add3-540908ab49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa554be-b406-4bc4-add3-540908ab49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030be467-0ec3-4cb6-a199-53980f81c90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f89375503624915925ffe4c0310424a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:57Z,use_quota=True,user_id='c3d5db7707154ea5a548821b2d736817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90f74cb-3f4f-43b8-b07b-72ade09b64ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90f74cb-3f4f-43b8-b07b-72ade09b64ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f9f770-0b38-4bf8-9391-b99d2b418169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f9f770-0b38-4bf8-9391-b99d2b418169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030be467-0ec3-4cb6-a199-53980f81c90e', 'volume_name': 'volume-030be467-0ec3-4cb6-a199-53980f81c90e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78d69cf-c7ba-4993-b552-c6b566b11894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78d69cf-c7ba-4993-b552-c6b566b11894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe70164-a4ce-4567-83ac-a1a277eb4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:57 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Volume 030be467-0ec3-4cb6-a199-53980f81c90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030be467-0ec3-4cb6-a199-53980f81c90e', 'volume_size': 1} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030be467-0ec3-4cb6-a199-53980f81c90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f89375503624915925ffe4c0310424a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:51:57Z,use_quota=True,user_id='c3d5db7707154ea5a548821b2d736817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Creating volume 030be467-0ec3-4cb6-a199-53980f81c90e {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:51:57 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:57 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e 1073741824 Jul 25 02:51:57 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Created reservations ['107a16d6-138d-40be-ae50-314746bd38c2', '2b083bef-5fc3-48c9-ade3-abca5ae091a1', '6326b7eb-b8b5-496c-b09c-c22273adcb80', 'b66bebad-d6e1-40ac-abd0-563a507c7602'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:57 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:51:57 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:51:57 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.335s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:51:57 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Deleted volume successfully. Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-c86cbba1-3cc9-4a7d-b634-4740b1fbf64c tempest-ProjectReaderTests-589485506 None] Lock "cinder-63cd467b-c137-4ec8-91b5-3fbe2bc4f339-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:51:57 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e 1073741824" returned: 0 in 0.590s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:57 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e Jul 25 02:51:57 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:58 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e" returned: 0 in 0.255s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.535s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe70164-a4ce-4567-83ac-a1a277eb4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030be467-0ec3-4cb6-a199-53980f81c90e', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9759b015-fd79-4fc4-b1c9-e324f0013bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Creating offline snapshot fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c of volume 829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:51:58 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Volume volume-030be467-0ec3-4cb6-a199-53980f81c90e (030be467-0ec3-4cb6-a199-53980f81c90e): created successfully Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9759b015-fd79-4fc4-b1c9-e324f0013bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Flow 'volume_create_manager' (e315e4ad-4737-4fd9-89ae-c1899d2e691f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[66179110-6b47-48fe-9e22-e36966c282f3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9f2c4336-35f9-43db-98b4-3d1de526740d tempest-CinderUnicodeTest-1659259970 None] Created volume successfully. Jul 25 02:51:58 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 Jul 25 02:51:58 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:58 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112" returned: 0 in 0.424s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:58 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c 1G Jul 25 02:51:58 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:59 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c 1G" returned: 0 in 0.496s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829fedd1-5349-4944-b2c6-e65f77b64112 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:59 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829fedd1-5349-4944-b2c6-e65f77b64112 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c Jul 25 02:51:59 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:59 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829fedd1-5349-4944-b2c6-e65f77b64112 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" returned: 0 in 0.428s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:59 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c is being set with open permissions: ugo+rw Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:59 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c Jul 25 02:51:59 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:59 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" returned: 0 in 0.339s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:51:59 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info Jul 25 02:51:59 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Flow 'volume_create_manager' (2ee8149a-2bf9-4ec8-80ca-567a49d7798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42313f3-d3a7-4c8e-9412-8dc5e42b54fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42313f3-d3a7-4c8e-9412-8dc5e42b54fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2105158248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa55b183-bfde-4843-97d8-d4c5da4c1d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f89375503624915925ffe4c0310424a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:00Z,use_quota=True,user_id='c3d5db7707154ea5a548821b2d736817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9a2f98-40bb-4929-a745-65351a2f7cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:51:59 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9a2f98-40bb-4929-a745-65351a2f7cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5872643d-e8a0-493c-882a-82e83534a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5872643d-e8a0-493c-882a-82e83534a86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa55b183-bfde-4843-97d8-d4c5da4c1d19', 'volume_name': 'volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35782bc-6d40-4370-b8a3-4ebf94df36f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35782bc-6d40-4370-b8a3-4ebf94df36f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be941ab-3941-4209-b781-c8ca8ed3ba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:00 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Volume fa55b183-bfde-4843-97d8-d4c5da4c1d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19', 'volume_size': 1} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:00 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info" returned: 0 in 0.316s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:00 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info is being set with open permissions: ugo+rw Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:00 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info Jul 25 02:52:00 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:00 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.info" returned: 0 in 0.288s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:51:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2105158248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa55b183-bfde-4843-97d8-d4c5da4c1d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f89375503624915925ffe4c0310424a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:00Z,use_quota=True,user_id='c3d5db7707154ea5a548821b2d736817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Creating volume fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:00 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-e444640e-9347-47d3-be41-b13c1f336a0a tempest-ProjectReaderTests-1529490971 None] Create snapshot completed successfully Jul 25 02:52:00 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 1073741824 Jul 25 02:52:00 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-829fedd1-5349-4944-b2c6-e65f77b64112" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-829fedd1-5349-4944-b2c6-e65f77b64112" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Deleting offline snapshot fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c of volume 829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] snapshot_file for this snap is: volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d708be3-3cc3-4d91-9c2a-c2ad1868f9e9]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:00 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c Jul 25 02:52:00 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:01 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 1073741824" returned: 0 in 0.657s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:01 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 Jul 25 02:52:01 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:01 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" returned: 0 in 0.446s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-829fedd1-5349-4944-b2c6-e65f77b64112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9df019-c070-46e7-a3d9-5f1a072cdf36]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:01 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 Jul 25 02:52:01 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:01 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19" returned: 0 in 0.282s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be941ab-3941-4209-b781-c8ca8ed3ba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97307a7e-7ddb-48a1-b25f-47bb308d9a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:01 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Volume volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 (fa55b183-bfde-4843-97d8-d4c5da4c1d19): created successfully Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97307a7e-7ddb-48a1-b25f-47bb308d9a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Flow 'volume_create_manager' (2ee8149a-2bf9-4ec8-80ca-567a49d7798d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-49adb085-c153-4411-8518-3689a1cd508a tempest-CinderUnicodeTest-1659259970 None] Created volume successfully. Jul 25 02:52:01 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112" returned: 0 in 0.388s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:01 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c Jul 25 02:52:01 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:02 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" returned: 0 in 0.382s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:02 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c Jul 25 02:52:02 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Creating offline snapshot 2c62942d-03b7-4eca-a33a-d71e50a5db29 of volume fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b8d97d-e223-43e9-b1ef-c0102ba029c3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:02 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112.fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:02 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 Jul 25 02:52:02 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c" released by "_delete_snapshot" :: held 1.624s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-829fedd1-5349-4944-b2c6-e65f77b64112" released by "delete_snapshot" :: held 1.657s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Created reservations ['f7cbc025-cf94-4957-a6e0-75d96aa23454', '2d591754-4116-4b02-a741-57e3d93f2b5f', 'b1fd2b73-3346-4720-888b-803501d3d1c1', 'f0c6e0f5-44e1-4c39-b5ce-3f9de0dbf193'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:02 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Delete snapshot completed successfully. Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-6d5cbdc0-da31-4371-8af8-401fc5fad283 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-fe98cc9b-ed1c-4e75-83ad-e7a419bc9b1c-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:02 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19" returned: 0 in 0.382s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:02 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 1G Jul 25 02:52:02 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-829fedd1-5349-4944-b2c6-e65f77b64112-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Lock "cinder-829fedd1-5349-4944-b2c6-e65f77b64112-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-829fedd1-5349-4944-b2c6-e65f77b64112" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-829fedd1-5349-4944-b2c6-e65f77b64112" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[db88d63b-b515-492a-b43d-6cc7c1b9df16]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:03 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 1G" returned: 0 in 0.505s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:03 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 Jul 25 02:52:03 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:03 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 Jul 25 02:52:03 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:03 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112" returned: 0 in 0.435s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:03 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29" returned: 0 in 0.334s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:03 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 is being set with open permissions: ugo+rw Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:03 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112 Jul 25 02:52:03 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:03 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 Jul 25 02:52:03 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:03 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-829fedd1-5349-4944-b2c6-e65f77b64112" returned: 0 in 0.287s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-829fedd1-5349-4944-b2c6-e65f77b64112" released by "delete_volume" :: held 0.793s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:03 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29" returned: 0 in 0.291s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:03 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info Jul 25 02:52:03 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Created reservations ['38ac6d2f-b451-40e7-bfe6-bb898bc4078e', 'c9eee61f-5259-481e-95fc-2f83b21db6ef', '131103a2-b3f1-4e0d-91d8-ea6d4317e4e1', '4b5667e0-7209-449e-a2a9-9505c0cd52d9'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:03 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:03 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:04 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info" returned: 0 in 0.332s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:04 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info is being set with open permissions: ugo+rw Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:04 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info Jul 25 02:52:04 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:04 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.278s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Deleted volume successfully. Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-d544a92e-a130-4c5e-ae1b-fefd112c905e tempest-ProjectReaderTests-1529490971 None] Lock "cinder-829fedd1-5349-4944-b2c6-e65f77b64112-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:04 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.info" returned: 0 in 0.339s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:04 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-69f57638-887b-45bf-a291-cb75a5c409b9 tempest-CinderUnicodeTest-1659259970 None] Create snapshot completed successfully Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (9892d333-1e14-4fc9-a9c6-199ccf2b82b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a05b7e9-af42-4d96-85a5-afc1aee96c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a05b7e9-af42-4d96-85a5-afc1aee96c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900301776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc58f4df-a5fb-4e0c-8a19-4c754e7589b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:05Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f908b38-fdbf-48c6-8cfc-07490d6e99c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f908b38-fdbf-48c6-8cfc-07490d6e99c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a0f257-86dc-4935-ad40-c2ffdfd69007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a0f257-86dc-4935-ad40-c2ffdfd69007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc58f4df-a5fb-4e0c-8a19-4c754e7589b5', 'volume_name': 'volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a026d89e-2c4e-4ffc-8be0-6b3b7c93931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a026d89e-2c4e-4ffc-8be0-6b3b7c93931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da134bb-9390-4522-8711-4937b3f0a804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:04 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Volume fc58f4df-a5fb-4e0c-8a19-4c754e7589b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5', 'volume_size': 1} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900301776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc58f4df-a5fb-4e0c-8a19-4c754e7589b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e9d5a9daaa4f27b5bb4a7863a191cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:05Z,use_quota=True,user_id='4e2b423877674bcaa14a27d12cc8af78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Creating volume fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:04 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:04 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 1073741824 Jul 25 02:52:04 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:05 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 1073741824" returned: 0 in 0.431s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:05 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 Jul 25 02:52:05 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-2c62942d-03b7-4eca-a33a-d71e50a5db29-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-2c62942d-03b7-4eca-a33a-d71e50a5db29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-quobyte-fa55b183-bfde-4843-97d8-d4c5da4c1d19" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-fa55b183-bfde-4843-97d8-d4c5da4c1d19" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-quobyte-2c62942d-03b7-4eca-a33a-d71e50a5db29" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-2c62942d-03b7-4eca-a33a-d71e50a5db29" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Deleting offline snapshot 2c62942d-03b7-4eca-a33a-d71e50a5db29 of volume fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:05 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] snapshot_file for this snap is: volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" returned: 0 in 0.326s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0e2d57-9c41-438b-810e-f45cba9e967f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da134bb-9390-4522-8711-4937b3f0a804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1f5dc-9ba0-480f-968e-8a0699b031d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:05 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Volume volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 (fc58f4df-a5fb-4e0c-8a19-4c754e7589b5): created successfully Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1f5dc-9ba0-480f-968e-8a0699b031d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Flow 'volume_create_manager' (9892d333-1e14-4fc9-a9c6-199ccf2b82b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-aa6a1dfb-7478-4eb1-b23e-af5640df0c23 tempest-ProjectReaderTests-1529490971 None] Created volume successfully. Jul 25 02:52:05 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 Jul 25 02:52:05 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:05 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29" returned: 0 in 0.389s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c2e22e-ec0b-42a3-8729-28cad4c68241]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:06 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 Jul 25 02:52:06 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:06 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19" returned: 0 in 0.369s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:06 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 Jul 25 02:52:06 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:06 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29" returned: 0 in 0.425s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:06 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29 Jul 25 02:52:06 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (153126db-805f-475e-b59d-109a522c2222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc0174-d557-4d36-b99a-2abd56f28174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc0174-d557-4d36-b99a-2abd56f28174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316676538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a72764-897f-49c6-8baa-81711f15ed3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:07Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3721e99-0719-4521-a4f8-c71df9bbc652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3721e99-0719-4521-a4f8-c71df9bbc652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41793653-835c-4d1d-a9b0-ceb9dc72ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41793653-835c-4d1d-a9b0-ceb9dc72ff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a72764-897f-49c6-8baa-81711f15ed3d', 'volume_name': 'volume-d2a72764-897f-49c6-8baa-81711f15ed3d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d839824-fc50-4b2e-af35-b7e167979252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d839824-fc50-4b2e-af35-b7e167979252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8e3b4c-34f5-4744-b1c9-0b191b0c35a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:06 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Volume d2a72764-897f-49c6-8baa-81711f15ed3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a72764-897f-49c6-8baa-81711f15ed3d', 'volume_size': 1} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316676538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a72764-897f-49c6-8baa-81711f15ed3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:07Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Creating volume d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:06 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:06 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d 1073741824 Jul 25 02:52:06 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:07 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19.2c62942d-03b7-4eca-a33a-d71e50a5db29" returned: 0 in 0.312s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-2c62942d-03b7-4eca-a33a-d71e50a5db29" released by "_delete_snapshot" :: held 1.622s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-fa55b183-bfde-4843-97d8-d4c5da4c1d19" released by "delete_snapshot" :: held 1.651s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Created reservations ['c5b5eff2-18e2-4fd4-9a9b-8ca03594658a', 'c9d105ef-749c-42c0-bcbb-d243f437f6a6', '70a5d812-17bb-44e2-9547-4067978c486c', '6f408d7a-36a8-4d3f-8317-14bf02916dfe'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Delete snapshot completed successfully. Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-07a066c9-d7bc-49ce-a181-cfe042bc1d82 tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-2c62942d-03b7-4eca-a33a-d71e50a5db29-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:07 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d 1073741824" returned: 0 in 0.452s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:07 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d Jul 25 02:52:07 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-fa55b183-bfde-4843-97d8-d4c5da4c1d19-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-fa55b183-bfde-4843-97d8-d4c5da4c1d19-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:07 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d" returned: 0 in 0.273s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.718s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-quobyte-fa55b183-bfde-4843-97d8-d4c5da4c1d19" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8e3b4c-34f5-4744-b1c9-0b191b0c35a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a72764-897f-49c6-8baa-81711f15ed3d', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b99df1-84e0-4f6f-9fff-9d66da03b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Creating offline snapshot cfc64295-d8e7-4c8c-b764-154ed81add15 of volume fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-fa55b183-bfde-4843-97d8-d4c5da4c1d19" acquired by "delete_volume" :: waited 0.041s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4bc10a-3200-4b42-83e6-44daa43c229c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee9cb7-457b-4c02-b71f-94d343d74d7c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:07 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Volume volume-d2a72764-897f-49c6-8baa-81711f15ed3d (d2a72764-897f-49c6-8baa-81711f15ed3d): created successfully Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b99df1-84e0-4f6f-9fff-9d66da03b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:07 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (153126db-805f-475e-b59d-109a522c2222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:07 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-62e02999-e1fa-40ac-a8da-687b3b2be645 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:52:07 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 Jul 25 02:52:07 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:07 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 Jul 25 02:52:07 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:08 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:08 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19" returned: 0 in 0.382s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:08 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 1G Jul 25 02:52:08 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:08 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19 Jul 25 02:52:08 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:08 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fa55b183-bfde-4843-97d8-d4c5da4c1d19" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-fa55b183-bfde-4843-97d8-d4c5da4c1d19" released by "delete_volume" :: held 0.711s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Created reservations ['cd1b96a3-3c61-460a-98a3-4ba34981812b', '48a4aeb0-c272-44dd-8b7c-acbf8d277a8d', '0e2a74c2-fb11-4181-b593-8f9b694ecbec', '4c04f475-a305-41cc-93ec-5dd8062b1094'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:08 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 1G" returned: 0 in 0.406s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:08 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 Jul 25 02:52:08 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:08 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:08 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-030be467-0ec3-4cb6-a199-53980f81c90e-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-030be467-0ec3-4cb6-a199-53980f81c90e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:08 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "cinder-quobyte-030be467-0ec3-4cb6-a199-53980f81c90e" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.314s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Deleted volume successfully. Jul 25 02:52:08 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-030be467-0ec3-4cb6-a199-53980f81c90e" acquired by "delete_volume" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15" returned: 0 in 0.384s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:08 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 is being set with open permissions: ugo+rw Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f14bfd8-bce1-4fce-a3d8-1889e27babbc]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:08 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 Jul 25 02:52:08 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-26895b5e-e02f-4d37-bdd6-4b31fe50901c tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-fa55b183-bfde-4843-97d8-d4c5da4c1d19-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:09 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e Jul 25 02:52:09 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:09 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:09 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info Jul 25 02:52:09 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:09 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e" returned: 0 in 0.427s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:09 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e Jul 25 02:52:09 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:09 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:09 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info is being set with open permissions: ugo+rw Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:09 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info Jul 25 02:52:09 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:09 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-030be467-0ec3-4cb6-a199-53980f81c90e" returned: 0 in 0.263s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-quobyte-030be467-0ec3-4cb6-a199-53980f81c90e" released by "delete_volume" :: held 0.746s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Created reservations ['9fd1d42c-db24-47fb-acf3-e98045532425', 'a0f715cd-f4be-4243-adb4-fbb5b1424ba8', '3214d3f7-e175-446d-9b91-58525d60da3d', '7c591ec9-8314-46a1-99af-cfc4eb371067'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:09 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.info" returned: 0 in 0.271s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.506s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:09 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:09 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot 6698823c-9096-4393-8deb-2a41fc1eeb63 of volume d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:09 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a3f01c5b-9316-480b-b7c5-286f540b3cef tempest-ProjectReaderTests-1529490971 None] Create snapshot completed successfully Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[af59f2db-b0eb-461d-99ef-710a06fe9459]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:10 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d Jul 25 02:52:10 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:10 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.277s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Deleted volume successfully. Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-eb070dc5-e5b4-4b93-9776-f706977788fa tempest-CinderUnicodeTest-1659259970 None] Lock "cinder-030be467-0ec3-4cb6-a199-53980f81c90e-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-cfc64295-d8e7-4c8c-b764-154ed81add15-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-cfc64295-d8e7-4c8c-b764-154ed81add15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-cfc64295-d8e7-4c8c-b764-154ed81add15" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-cfc64295-d8e7-4c8c-b764-154ed81add15" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Deleting offline snapshot cfc64295-d8e7-4c8c-b764-154ed81add15 of volume fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] snapshot_file for this snap is: volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a56559-a8d2-4e13-bdde-c790298172af]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:10 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d" returned: 0 in 0.458s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:10 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 1G Jul 25 02:52:10 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:10 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 Jul 25 02:52:10 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:10 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15" returned: 0 in 0.398s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:10 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03f48ae-a18f-45fd-aa59-645186d2ab97]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 1G" returned: 0 in 0.438s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a72764-897f-49c6-8baa-81711f15ed3d -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:10 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a72764-897f-49c6-8baa-81711f15ed3d -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 Jul 25 02:52:10 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:10 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 Jul 25 02:52:10 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:11 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a72764-897f-49c6-8baa-81711f15ed3d -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63" returned: 0 in 0.324s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:11 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 is being set with open permissions: ugo+rw Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:11 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 Jul 25 02:52:11 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:11 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" returned: 0 in 0.402s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:11 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 Jul 25 02:52:11 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:11 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:11 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info Jul 25 02:52:11 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:11 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15" returned: 0 in 0.476s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:11 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15 Jul 25 02:52:11 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:11 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:11 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info is being set with open permissions: ugo+rw Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:11 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info Jul 25 02:52:11 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:11 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5.cfc64295-d8e7-4c8c-b764-154ed81add15" returned: 0 in 0.278s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-cfc64295-d8e7-4c8c-b764-154ed81add15" released by "_delete_snapshot" :: held 1.692s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:11 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" released by "delete_snapshot" :: held 1.725s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:12 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.info" returned: 0 in 0.265s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Created reservations ['5576adf8-73b4-4d7e-9536-b3c693f5cfd9', '9e2c0e63-eec2-4798-b524-eb6173e4fdee', '8fb4783b-0278-4d9a-8de8-266b6c88788d', '1f378182-e7f1-40f7-85ab-08316009c7df'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-91c6edbd-f06e-4ffc-bf06-7996c3f61504 tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:52:12 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Delete snapshot completed successfully. Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-240e4478-6e10-42ac-ad39-8a18117ae850 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-cfc64295-d8e7-4c8c-b764-154ed81add15-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "cinder-quobyte-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-6698823c-9096-4393-8deb-2a41fc1eeb63-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" acquired by "delete_volume" :: waited 0.038s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-6698823c-9096-4393-8deb-2a41fc1eeb63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-d2a72764-897f-49c6-8baa-81711f15ed3d" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-d2a72764-897f-49c6-8baa-81711f15ed3d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-6698823c-9096-4393-8deb-2a41fc1eeb63" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7b195e-d4cb-46a2-a772-e845b0ad60e1]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-6698823c-9096-4393-8deb-2a41fc1eeb63" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot 6698823c-9096-4393-8deb-2a41fc1eeb63 of volume d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5f183-deba-4b60-ae0f-23cdc8d1e959]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:12 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 Jul 25 02:52:12 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:12 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 Jul 25 02:52:12 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:12 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:13 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5 Jul 25 02:52:13 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:13 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63" returned: 0 in 0.417s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a72764-897f-49c6-8baa-81711f15ed3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cff3df-2ace-4ae7-809a-87842a8cb1cf]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:13 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d Jul 25 02:52:13 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:13 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" returned: 0 in 0.279s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-quobyte-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5" released by "delete_volume" :: held 0.772s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Created reservations ['ff73a07a-5730-443e-b281-2502536796cf', '34b06363-634d-4564-b9c8-f9c5e8329c99', 'fc426023-81e8-4503-be55-19a8f94824f0', '31183237-4a92-4472-a914-6fbc38c0c6f8'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:13 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:13 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:13 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d" returned: 0 in 0.436s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-8fcdcd7f-5207-4dd4-bd4d-c41d70e87a64 tempest-ProjectAdminTests-1705590551 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88279) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 25 02:52:13 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 Jul 25 02:52:13 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:13 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.309s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Deleted volume successfully. Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-660ac1e1-dbd9-4e49-aef6-da5ef783a117 tempest-ProjectReaderTests-1529490971 None] Lock "cinder-fc58f4df-a5fb-4e0c-8a19-4c754e7589b5-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:13 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63" returned: 0 in 0.448s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:14 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63 Jul 25 02:52:14 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:14 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d.6698823c-9096-4393-8deb-2a41fc1eeb63" returned: 0 in 0.274s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-6698823c-9096-4393-8deb-2a41fc1eeb63" released by "_delete_snapshot" :: held 1.701s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-d2a72764-897f-49c6-8baa-81711f15ed3d" released by "delete_snapshot" :: held 1.737s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Created reservations ['bce00944-6fbe-4699-845a-5070aa5d4954', 'ded9896f-fb41-4add-94d5-7c7da4ccde20', '8452b8dd-1497-46ed-9d66-df51612a41f5', '5a30552f-69ae-4ccd-89f5-30fe8cae3988'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:14 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-61b4e4a2-898f-4d4d-986a-dda9a2e862b1 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-6698823c-9096-4393-8deb-2a41fc1eeb63-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-d2a72764-897f-49c6-8baa-81711f15ed3d-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-d2a72764-897f-49c6-8baa-81711f15ed3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-d2a72764-897f-49c6-8baa-81711f15ed3d" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-d2a72764-897f-49c6-8baa-81711f15ed3d" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2530e034-e0f7-4cdb-a9b8-920bcc96630d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:14 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d Jul 25 02:52:14 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:15 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d" returned: 0 in 0.445s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:15 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d Jul 25 02:52:15 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:15 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-d2a72764-897f-49c6-8baa-81711f15ed3d" returned: 0 in 0.283s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-d2a72764-897f-49c6-8baa-81711f15ed3d" released by "delete_volume" :: held 0.813s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Created reservations ['5060b36d-a3d4-4388-867a-7e88975ee518', '38197826-f78b-4894-9cbc-67ba977bc43b', '01c077be-ffc7-440f-823a-c69f009d40ed', '35eb2963-b904-4d8a-a867-727b8f5a286d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:15 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:15 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:16 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.284s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:16 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a056e982-648e-4892-b535-f7dcf7ed5ca4 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-d2a72764-897f-49c6-8baa-81711f15ed3d-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (5f364936-e373-4fcc-87bf-83d3bffc4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07ec216-e6e7-4cbf-a493-63497d29a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07ec216-e6e7-4cbf-a493-63497d29a121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989599869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c84ef28-b015-4e12-85f7-9d18c5bf4085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:16Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c42a3d7-c5df-49ec-87b8-6dcb40092832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c42a3d7-c5df-49ec-87b8-6dcb40092832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3178ff0-91f1-4ede-a157-c30c7006910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3178ff0-91f1-4ede-a157-c30c7006910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c84ef28-b015-4e12-85f7-9d18c5bf4085', 'volume_name': 'volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562d3af6-fcfa-4720-98fd-cbf85315e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562d3af6-fcfa-4720-98fd-cbf85315e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f740b83b-699f-4298-abee-375b7a14adaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:16 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Volume 1c84ef28-b015-4e12-85f7-9d18c5bf4085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085', 'volume_size': 1} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989599869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c84ef28-b015-4e12-85f7-9d18c5bf4085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:16Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Creating volume 1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:16 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:16 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 1073741824 Jul 25 02:52:16 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:17 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 1073741824" returned: 0 in 0.487s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:17 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 Jul 25 02:52:17 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:17 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f740b83b-699f-4298-abee-375b7a14adaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf44e65e-a7de-4db0-8624-11bdf64bc682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:17 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Volume volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 (1c84ef28-b015-4e12-85f7-9d18c5bf4085): created successfully Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf44e65e-a7de-4db0-8624-11bdf64bc682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (5f364936-e373-4fcc-87bf-83d3bffc4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-58f2a5ca-6c04-4d0b-b330-19bf52681747 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:52:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot 45b6e138-2399-4b1b-81c0-775642a24306 of volume 1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94639e4-84de-4917-892d-162826eb5fd7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:18 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 Jul 25 02:52:18 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:19 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:19 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 1G Jul 25 02:52:19 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:19 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 1G" returned: 0 in 0.503s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:19 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 Jul 25 02:52:19 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:20 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306" returned: 0 in 0.389s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:20 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 is being set with open permissions: ugo+rw Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:20 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 Jul 25 02:52:20 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:20 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306" returned: 0 in 0.282s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:20 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info Jul 25 02:52:20 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:20 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info" returned: 0 in 0.278s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:20 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info is being set with open permissions: ugo+rw Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:20 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info Jul 25 02:52:20 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:20 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.info" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-89785e1a-caf9-42c9-ac99-c8413b65678b tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-45b6e138-2399-4b1b-81c0-775642a24306-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Lock "cinder-45b6e138-2399-4b1b-81c0-775642a24306-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-1c84ef28-b015-4e12-85f7-9d18c5bf4085" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1c84ef28-b015-4e12-85f7-9d18c5bf4085" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-45b6e138-2399-4b1b-81c0-775642a24306" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-45b6e138-2399-4b1b-81c0-775642a24306" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot 45b6e138-2399-4b1b-81c0-775642a24306 of volume 1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1143162a-ec4d-4a2c-92c5-12a588e19fb3]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:22 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 Jul 25 02:52:22 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:22 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306" returned: 0 in 0.416s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c31dbc-082f-4a14-a7fa-91102190e917]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:22 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 Jul 25 02:52:22 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:22 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085" returned: 0 in 0.482s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:22 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 Jul 25 02:52:23 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:23 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306" returned: 0 in 0.443s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:23 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306 Jul 25 02:52:23 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:23 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085.45b6e138-2399-4b1b-81c0-775642a24306" returned: 0 in 0.311s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-45b6e138-2399-4b1b-81c0-775642a24306" released by "_delete_snapshot" :: held 1.785s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1c84ef28-b015-4e12-85f7-9d18c5bf4085" released by "delete_snapshot" :: held 1.824s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Created reservations ['75460c82-9d15-428e-91cb-f116b35c216b', '6f7d0056-c170-418a-8f28-2c234d35e7f5', '64fa6905-1a16-4013-b48a-bf38a5892dd3', '1c90ecaa-315d-468b-ba02-fa1f8d5a901c'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:23 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:52:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-30d1327f-0071-48d7-94f1-833305629a1d tempest-ProjectMemberTests-1855424396 None] Lock "cinder-45b6e138-2399-4b1b-81c0-775642a24306-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-1c84ef28-b015-4e12-85f7-9d18c5bf4085-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Lock "cinder-1c84ef28-b015-4e12-85f7-9d18c5bf4085-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-1c84ef28-b015-4e12-85f7-9d18c5bf4085" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1c84ef28-b015-4e12-85f7-9d18c5bf4085" acquired by "delete_volume" :: waited 0.028s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[450d12b2-cde8-4e79-adb5-9c672de604c9]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:24 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 Jul 25 02:52:24 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:24 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085" returned: 0 in 0.418s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:24 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085 Jul 25 02:52:24 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:25 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1c84ef28-b015-4e12-85f7-9d18c5bf4085" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1c84ef28-b015-4e12-85f7-9d18c5bf4085" released by "delete_volume" :: held 0.768s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Created reservations ['807c046c-3350-4abd-a6d5-8aa14b4fc097', '43a749f5-30cc-44fb-ae0d-25bd31670434', '06dd0f6e-07db-4467-a1de-f593e70f8b86', '519ccc0d-3e46-41ff-bebe-224501d2e9a6'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:25 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:25 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:25 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.359s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:25 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:52:25 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-085bc00e-5efa-46c4-ab0c-23d04880045c tempest-ProjectMemberTests-1855424396 None] Lock "cinder-1c84ef28-b015-4e12-85f7-9d18c5bf4085-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (dcaf04d2-ab0a-4826-90fa-39dc85eb2620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cb1e43-c1ee-41d7-a0a9-d0a8e3b886fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cb1e43-c1ee-41d7-a0a9-d0a8e3b886fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820283608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce9144d-7c8d-49a2-bb3d-05e8cc612761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:26Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e6d4a2-6f1a-4990-b10f-7a5d4e1fb868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e6d4a2-6f1a-4990-b10f-7a5d4e1fb868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af0d498-0e90-465d-b88b-60f6f8617994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af0d498-0e90-465d-b88b-60f6f8617994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce9144d-7c8d-49a2-bb3d-05e8cc612761', 'volume_name': 'volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbafbc88-bc5e-4e16-a1be-719d6ab2fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbafbc88-bc5e-4e16-a1be-719d6ab2fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a32c8f-22d4-4403-aeea-6693f6243ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:26 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Volume 1ce9144d-7c8d-49a2-bb3d-05e8cc612761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761', 'volume_size': 1} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820283608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce9144d-7c8d-49a2-bb3d-05e8cc612761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:26Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Creating volume 1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:26 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:26 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 1073741824 Jul 25 02:52:26 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:26 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 1073741824" returned: 0 in 0.560s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:26 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:26 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 Jul 25 02:52:26 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:27 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" returned: 0 in 0.344s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a32c8f-22d4-4403-aeea-6693f6243ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb0c011-6d23-4ae5-9792-7b7868797573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:27 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Volume volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 (1ce9144d-7c8d-49a2-bb3d-05e8cc612761): created successfully Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb0c011-6d23-4ae5-9792-7b7868797573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:27 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (dcaf04d2-ab0a-4826-90fa-39dc85eb2620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:27 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fda56be0-0b51-4151-b73c-0a7c43e28224 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot 6aa56caa-4b45-484b-8398-d2c328f2ac1b of volume 1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7950b40-98fe-44c8-baeb-27394f5b171a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:28 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 Jul 25 02:52:28 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:28 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" returned: 0 in 0.400s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:28 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:28 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b 1G Jul 25 02:52:28 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:29 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b 1G" returned: 0 in 0.415s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:29 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b Jul 25 02:52:29 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:29 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b" returned: 0 in 0.355s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:29 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b is being set with open permissions: ugo+rw Jul 25 02:52:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:29 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b Jul 25 02:52:29 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:29 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b" returned: 0 in 0.257s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:29 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:29 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info Jul 25 02:52:29 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:30 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info" returned: 0 in 0.268s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:30 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info is being set with open permissions: ugo+rw Jul 25 02:52:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:30 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info Jul 25 02:52:30 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:30 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.info" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:30 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:30 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-fe471fb5-04e6-46de-a383-b2c9f4df8ce6 tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-6aa56caa-4b45-484b-8398-d2c328f2ac1b-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Lock "cinder-6aa56caa-4b45-484b-8398-d2c328f2ac1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-6aa56caa-4b45-484b-8398-d2c328f2ac1b" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-6aa56caa-4b45-484b-8398-d2c328f2ac1b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot 6aa56caa-4b45-484b-8398-d2c328f2ac1b of volume 1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff922b-f4d1-479e-8f26-38e9ca9654a7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:31 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:31 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b Jul 25 02:52:31 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:32 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b" returned: 0 in 0.422s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c868a8-3269-4b03-a9f9-79d8ed23827d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:32 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 Jul 25 02:52:32 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:32 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" returned: 0 in 0.441s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:32 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b Jul 25 02:52:32 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:32 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b" returned: 0 in 0.336s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:32 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:32 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b Jul 25 02:52:32 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:33 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761.6aa56caa-4b45-484b-8398-d2c328f2ac1b" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-6aa56caa-4b45-484b-8398-d2c328f2ac1b" released by "_delete_snapshot" :: held 1.605s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" released by "delete_snapshot" :: held 1.639s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Created reservations ['ccb91907-e139-4970-84bc-a1240ebcd864', '24153be3-19e9-4b74-89eb-990282293c75', '322c7436-dfe2-4464-aba0-2219db7fd7fe', 'a6f48452-7ada-4748-9ff8-8cfacf85f099'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:33 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-705fc26f-dd4d-431d-aed6-41d376f1181a tempest-ProjectMemberTests-1855424396 None] Lock "cinder-6aa56caa-4b45-484b-8398-d2c328f2ac1b-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-1ce9144d-7c8d-49a2-bb3d-05e8cc612761-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-1ce9144d-7c8d-49a2-bb3d-05e8cc612761-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa5f4f-a44e-4538-ac47-7f4d4cfff6ab]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:33 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:33 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 Jul 25 02:52:33 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:34 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" returned: 0 in 0.385s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:34 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761 Jul 25 02:52:34 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:34 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" returned: 0 in 0.277s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-1ce9144d-7c8d-49a2-bb3d-05e8cc612761" released by "delete_volume" :: held 0.719s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Created reservations ['d21ca698-7a7b-4fc1-be05-9721d15d0e19', 'd2ae5d7e-b400-4fb5-9193-7b8a46c8e9ea', 'be6a4a8a-9e40-4111-9da2-08983061153e', 'c2104fbb-538d-4d20-a2df-627922492a78'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:34 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:34 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:34 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:34 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:52:34 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-8ea3edf3-1920-4961-bce4-740296d7f713 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-1ce9144d-7c8d-49a2-bb3d-05e8cc612761-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (b1b2fe1e-c961-4e01-98b1-33380276b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed52e2ad-a8d7-4f37-ac36-13fbf64d01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed52e2ad-a8d7-4f37-ac36-13fbf64d01a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587835782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8d9566-7884-4e60-9db8-02912dd3703a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:35Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c5861-87e6-4577-9901-3ca789847681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c5861-87e6-4577-9901-3ca789847681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99652bec-b9ea-45f4-aa6f-fc5b3b247442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99652bec-b9ea-45f4-aa6f-fc5b3b247442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8d9566-7884-4e60-9db8-02912dd3703a', 'volume_name': 'volume-da8d9566-7884-4e60-9db8-02912dd3703a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c77db6-0700-4f32-a88f-28db3d3471d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c77db6-0700-4f32-a88f-28db3d3471d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24faab2c-afcf-4270-8b2f-b77362c79c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:35 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Volume da8d9566-7884-4e60-9db8-02912dd3703a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8d9566-7884-4e60-9db8-02912dd3703a', 'volume_size': 1} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587835782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8d9566-7884-4e60-9db8-02912dd3703a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:35Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Creating volume da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:35 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:35 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a 1073741824 Jul 25 02:52:35 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:35 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a 1073741824" returned: 0 in 0.433s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:35 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:35 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a Jul 25 02:52:35 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:36 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a" returned: 0 in 0.259s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24faab2c-afcf-4270-8b2f-b77362c79c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8d9566-7884-4e60-9db8-02912dd3703a', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8a22ca-c8a4-4f31-9a23-e92958536099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:36 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Volume volume-da8d9566-7884-4e60-9db8-02912dd3703a (da8d9566-7884-4e60-9db8-02912dd3703a): created successfully Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8a22ca-c8a4-4f31-9a23-e92958536099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (b1b2fe1e-c961-4e01-98b1-33380276b222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:36 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-168f4cc0-39f3-4ca7-ac41-0c65b2cc01cd tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot b58c8977-a30f-468f-a9bf-113506863483 of volume da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d34bb-3690-42c7-b19c-e827a6346f4e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:36 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a Jul 25 02:52:36 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:36 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:36 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:36 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 1G Jul 25 02:52:36 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:37 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 1G" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da8d9566-7884-4e60-9db8-02912dd3703a -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:37 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da8d9566-7884-4e60-9db8-02912dd3703a -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 Jul 25 02:52:37 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:37 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da8d9566-7884-4e60-9db8-02912dd3703a -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483" returned: 0 in 0.382s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:37 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 is being set with open permissions: ugo+rw Jul 25 02:52:37 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:37 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 Jul 25 02:52:37 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:38 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483" returned: 0 in 0.271s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:38 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info Jul 25 02:52:38 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:38 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:38 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info is being set with open permissions: ugo+rw Jul 25 02:52:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:38 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info Jul 25 02:52:38 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:38 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.info" returned: 0 in 0.290s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:38 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:38 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-7369137d-e89a-43b4-8ecc-108fa0ce6af7 tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-b58c8977-a30f-468f-a9bf-113506863483-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-b58c8977-a30f-468f-a9bf-113506863483-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-da8d9566-7884-4e60-9db8-02912dd3703a" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-da8d9566-7884-4e60-9db8-02912dd3703a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-b58c8977-a30f-468f-a9bf-113506863483" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-b58c8977-a30f-468f-a9bf-113506863483" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot b58c8977-a30f-468f-a9bf-113506863483 of volume da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a0d01-87a7-4eef-b364-26502f56c99f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:39 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:39 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 Jul 25 02:52:39 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:40 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483" returned: 0 in 0.421s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:40 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da8d9566-7884-4e60-9db8-02912dd3703a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:40 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0474a5-4a68-4b01-bf96-0fa011efda96]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:40 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a Jul 25 02:52:40 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:40 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:40 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:40 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 Jul 25 02:52:40 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:41 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483" returned: 0 in 0.341s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:41 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483 Jul 25 02:52:41 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:41 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a.b58c8977-a30f-468f-a9bf-113506863483" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-b58c8977-a30f-468f-a9bf-113506863483" released by "_delete_snapshot" :: held 1.513s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-da8d9566-7884-4e60-9db8-02912dd3703a" released by "delete_snapshot" :: held 1.550s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Created reservations ['325e097b-ae5a-4954-9163-220dc741e922', '036f3219-8aa1-4efa-8b8f-92e48058af3d', '42c810e0-8547-4cb8-ae9f-9c9825fc41d0', 'fe59224e-75b6-4ca8-a0e8-d89627439213'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:41 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-4dca29f7-76e6-450c-a79a-30277434efb7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-b58c8977-a30f-468f-a9bf-113506863483-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-da8d9566-7884-4e60-9db8-02912dd3703a-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:41 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-da8d9566-7884-4e60-9db8-02912dd3703a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-da8d9566-7884-4e60-9db8-02912dd3703a" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-da8d9566-7884-4e60-9db8-02912dd3703a" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d498f8-3812-4ccf-a402-4f516f6b0b2d]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:42 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a Jul 25 02:52:42 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:42 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a" returned: 0 in 0.474s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:42 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a Jul 25 02:52:42 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:42 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-da8d9566-7884-4e60-9db8-02912dd3703a" returned: 0 in 0.275s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-da8d9566-7884-4e60-9db8-02912dd3703a" released by "delete_volume" :: held 0.820s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Created reservations ['699c72df-50d4-49d6-b12d-8926710fc5c8', '9495335e-bc3d-4bc8-9b1f-4b5febd9afa0', 'ad1fb2d4-f760-4e0e-8504-f65ae4642ab4', '1b55f3bb-da49-4da5-a83e-9b703c80722d'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:42 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:43 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:43 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:43 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.318s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:43 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ef8dce1f-3b49-46e0-9fee-b32150f3b323 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-da8d9566-7884-4e60-9db8-02912dd3703a-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Flow 'volume_create_manager' (e18ef4d5-e92c-4fff-bdfd-59f034ec403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6dde43-57f2-475f-8b70-0238a6f53209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6dde43-57f2-475f-8b70-0238a6f53209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-611827057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59941dff-200a-421a-bfe0-a21e516e8f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d6301ef31241208afbe71388c73091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:43Z,use_quota=True,user_id='24efc97d2d22452ebdbad81c59e70930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece13f67-ebb0-486d-ba3e-3831b1c80b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece13f67-ebb0-486d-ba3e-3831b1c80b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fa2290-def2-4882-9001-f4fc2910c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fa2290-def2-4882-9001-f4fc2910c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59941dff-200a-421a-bfe0-a21e516e8f68', 'volume_name': 'volume-59941dff-200a-421a-bfe0-a21e516e8f68', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2095f46f-f197-485e-928f-381b2d38471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2095f46f-f197-485e-928f-381b2d38471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223a748a-0871-499e-a08e-bf57ba899a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Volume 59941dff-200a-421a-bfe0-a21e516e8f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59941dff-200a-421a-bfe0-a21e516e8f68', 'volume_size': 1} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-611827057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59941dff-200a-421a-bfe0-a21e516e8f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d6301ef31241208afbe71388c73091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:43Z,use_quota=True,user_id='24efc97d2d22452ebdbad81c59e70930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Creating volume 59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:43 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:43 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 1073741824 Jul 25 02:52:43 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (2f316c44-1a1b-4225-8507-3e336aa41cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1896daa9-5248-4918-bd39-fa64f6278cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1896daa9-5248-4918-bd39-fa64f6278cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224775212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c39818-beff-4946-8325-fd2c9978d31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:44Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537dc3d7-2fe0-4954-9699-e2fd1b3906f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537dc3d7-2fe0-4954-9699-e2fd1b3906f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d42df9-7c87-46f8-b273-767eef3c65b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d42df9-7c87-46f8-b273-767eef3c65b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c39818-beff-4946-8325-fd2c9978d31b', 'volume_name': 'volume-03c39818-beff-4946-8325-fd2c9978d31b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc497ff4-8e59-4983-9347-a9e8f730556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc497ff4-8e59-4983-9347-a9e8f730556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d61378-e827-4a43-9bf6-64dd8d0e4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:43 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Volume 03c39818-beff-4946-8325-fd2c9978d31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c39818-beff-4946-8325-fd2c9978d31b', 'volume_size': 1} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:43 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 1073741824" returned: 0 in 0.401s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:43 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:43 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:43 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:44 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.241s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224775212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c39818-beff-4946-8325-fd2c9978d31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:44Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Creating volume 03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:44 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223a748a-0871-499e-a08e-bf57ba899a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59941dff-200a-421a-bfe0-a21e516e8f68', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:44 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b 1073741824 Jul 25 02:52:44 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a62a855-447a-4d30-9b30-8710dd0f1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Volume volume-59941dff-200a-421a-bfe0-a21e516e8f68 (59941dff-200a-421a-bfe0-a21e516e8f68): created successfully Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a62a855-447a-4d30-9b30-8710dd0f1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Flow 'volume_create_manager' (e18ef4d5-e92c-4fff-bdfd-59f034ec403f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:44 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-4a97f4c2-694c-4749-a7e0-ad1833ae34f4 tempest-SnapshotDependencyTests-90968091 None] Created volume successfully. Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:44 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b 1073741824" returned: 0 in 0.481s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:44 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b Jul 25 02:52:44 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:44 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b" returned: 0 in 0.233s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.282s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d61378-e827-4a43-9bf6-64dd8d0e4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c39818-beff-4946-8325-fd2c9978d31b', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a66b2f1-668f-4404-8a59-7af25fec623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Creating offline snapshot d173e8c5-af92-4d9b-89e7-2ed3fa36a836 of volume 59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:44 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Volume volume-03c39818-beff-4946-8325-fd2c9978d31b (03c39818-beff-4946-8325-fd2c9978d31b): created successfully Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a66b2f1-668f-4404-8a59-7af25fec623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:44 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (2f316c44-1a1b-4225-8507-3e336aa41cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[881bc5bf-e32a-4c44-ad14-f7d3b91b3ce2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:45 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-b1210560-c369-4a2c-bc7a-aeeda6fcea22 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:52:45 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:45 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:45 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.351s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:45 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 1G Jul 25 02:52:45 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:45 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 1G" returned: 0 in 0.419s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59941dff-200a-421a-bfe0-a21e516e8f68 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:45 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59941dff-200a-421a-bfe0-a21e516e8f68 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 Jul 25 02:52:45 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:45 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:46 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59941dff-200a-421a-bfe0-a21e516e8f68 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836" returned: 0 in 0.303s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:46 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 is being set with open permissions: ugo+rw Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:46 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 Jul 25 02:52:46 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:46 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836" returned: 0 in 0.238s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:46 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info Jul 25 02:52:46 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:46 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:46 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info is being set with open permissions: ugo+rw Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:46 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info Jul 25 02:52:46 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:46 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.info" returned: 0 in 0.243s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot a0156634-e018-44c5-a596-3fe39cfbbdfd of volume 03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:46 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-1f8a3da3-ff8c-4ac6-805b-43ee29b7f063 tempest-SnapshotDependencyTests-90968091 None] Create snapshot completed successfully Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556771d-5a72-4e57-9100-10c74db01cd0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:46 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:47 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b Jul 25 02:52:47 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:47 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:47 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd 1G Jul 25 02:52:47 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:47 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd 1G" returned: 0 in 0.400s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:47 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c39818-beff-4946-8325-fd2c9978d31b -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:47 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c39818-beff-4946-8325-fd2c9978d31b -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd Jul 25 02:52:47 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:47 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c39818-beff-4946-8325-fd2c9978d31b -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd" returned: 0 in 0.328s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:48 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd is being set with open permissions: ugo+rw Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:48 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd Jul 25 02:52:48 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:48 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd" returned: 0 in 0.274s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:48 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info Jul 25 02:52:48 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Flow 'volume_create_manager' (7044bfdb-3c86-407f-83ed-22314c80881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ff7074-c0e0-4881-bff0-c7e853f77e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ff7074-c0e0-4881-bff0-c7e853f77e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d46b7da-e80b-4667-934c-a64857d22663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d6301ef31241208afbe71388c73091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d173e8c5-af92-4d9b-89e7-2ed3fa36a836,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:48Z,use_quota=True,user_id='24efc97d2d22452ebdbad81c59e70930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3ce3d1-734c-4ae8-a39e-37c6984e96b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:48 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3ce3d1-734c-4ae8-a39e-37c6984e96b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ade5278-bd15-45d6-bf52-2c791e0090a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ade5278-bd15-45d6-bf52-2c791e0090a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d46b7da-e80b-4667-934c-a64857d22663', 'volume_name': 'volume-7d46b7da-e80b-4667-934c-a64857d22663', 'volume_size': 1, 'snapshot_id': 'd173e8c5-af92-4d9b-89e7-2ed3fa36a836'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ded1574-a47d-4dac-8f90-712c7bd39b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ded1574-a47d-4dac-8f90-712c7bd39b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a192d3c1-dfd6-436e-8bfb-4de125e708ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:48 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Volume 7d46b7da-e80b-4667-934c-a64857d22663: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d46b7da-e80b-4667-934c-a64857d22663', 'volume_size': 1, 'snapshot_id': 'd173e8c5-af92-4d9b-89e7-2ed3fa36a836'} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info" returned: 0 in 0.292s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:48 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info is being set with open permissions: ugo+rw Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:48 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info Jul 25 02:52:48 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:48 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.info" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.245s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-quobyte-d173e8c5-af92-4d9b-89e7-2ed3fa36a836-7d46b7da-e80b-4667-934c-a64857d22663" by "_create_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-d173e8c5-af92-4d9b-89e7-2ed3fa36a836-7d46b7da-e80b-4667-934c-a64857d22663" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Creating volume 7d46b7da-e80b-4667-934c-a64857d22663 from snapshot d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-quobyte-7d46b7da-e80b-4667-934c-a64857d22663" by "_copy_volume_from_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:48 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3d4fd436-ae79-4d3e-8aae-04377f7e09fc tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-7d46b7da-e80b-4667-934c-a64857d22663" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] snapshot: d173e8c5-af92-4d9b-89e7-2ed3fa36a836, volume: 7d46b7da-e80b-4667-934c-a64857d22663, {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:48 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c114014-1ed1-44ad-be12-83e7ebf4e002]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-a0156634-e018-44c5-a596-3fe39cfbbdfd-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Lock "cinder-a0156634-e018-44c5-a596-3fe39cfbbdfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-03c39818-beff-4946-8325-fd2c9978d31b" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-03c39818-beff-4946-8325-fd2c9978d31b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-a0156634-e018-44c5-a596-3fe39cfbbdfd" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-a0156634-e018-44c5-a596-3fe39cfbbdfd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot a0156634-e018-44c5-a596-3fe39cfbbdfd of volume 03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:49 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 Jul 25 02:52:49 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5397cf54-622f-4401-a179-19c77314d608]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:49 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd Jul 25 02:52:49 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:49 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836" returned: 0 in 0.373s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59941dff-200a-421a-bfe0-a21e516e8f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Creating direct copy from snapshot {{(pid=88279) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7957336-6d7e-4b58-abc4-99f3d407ee72]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:49 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd" returned: 0 in 0.356s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03c39818-beff-4946-8325-fd2c9978d31b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a77c18a-db67-41fb-ae6a-a1c5da351d04]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:49 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:49 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:49 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b Jul 25 02:52:49 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:49 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.373s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG cinder.utils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Path /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 not found in is_blk_device check {{(pid=88279) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:49 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 Jul 25 02:52:49 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:49 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b" returned: 0 in 0.364s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:49 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:49 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd Jul 25 02:52:49 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:50 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd" returned: 0 in 0.364s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:50 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd Jul 25 02:52:50 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:50 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:50 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:51 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b.a0156634-e018-44c5-a596-3fe39cfbbdfd" returned: 0 in 0.778s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-a0156634-e018-44c5-a596-3fe39cfbbdfd" released by "_delete_snapshot" :: held 2.010s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-03c39818-beff-4946-8325-fd2c9978d31b" released by "delete_snapshot" :: held 2.042s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Created reservations ['884ca15e-41af-4f21-a844-636a7dde63b2', '53ee6707-bbc7-4309-ab99-e3314c78b084', 'bf0999e4-5c5d-4bf8-aeef-b4f8b67622b4', 'e4702221-773f-4301-94b9-8c62a3cda174'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:51 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-62dbe131-9aff-4922-9ed8-f4bd8998fc1b tempest-ProjectMemberTests-1855424396 None] Lock "cinder-a0156634-e018-44c5-a596-3fe39cfbbdfd-delete_snapshot" released by "delete_snapshot" :: held 2.490s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:51 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.823s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:52:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 25 02:52:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-03c39818-beff-4946-8325-fd2c9978d31b-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-03c39818-beff-4946-8325-fd2c9978d31b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-03c39818-beff-4946-8325-fd2c9978d31b" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:52 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-03c39818-beff-4946-8325-fd2c9978d31b" acquired by "delete_volume" :: waited 0.030s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:52 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d367e88-2d97-4237-8269-927ee09b04b7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:52 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:52 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b Jul 25 02:52:52 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:53 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b" returned: 0 in 0.648s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:53 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b Jul 25 02:52:53 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:53 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:53 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-03c39818-beff-4946-8325-fd2c9978d31b" returned: 0 in 0.470s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:53 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-03c39818-beff-4946-8325-fd2c9978d31b" released by "delete_volume" :: held 1.273s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:53 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Created reservations ['73bb9b98-b827-427f-ac4e-4c2950be1561', '8c9d9e50-f235-45d1-8206-cd03a39d6034', '75366d5c-2c73-4bab-86f5-e27d8f6536ff', '9038c652-a864-4bca-a86f-ffadbc4dc139'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:54 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:54 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:54 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663" returned: 0 in 4.611s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1341250-2556-4c68-b71a-e354d3e43606]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:54 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.363s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:54 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-29f7f9ac-723d-4450-8b48-2ac3a31de34f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-03c39818-beff-4946-8325-fd2c9978d31b-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:54 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:54 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:54 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.540s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG cinder.image.image_utils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Image conversion details: src /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 {{(pid=88279) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 25 02:52:54 devstack cinder-volume[88279]: INFO cinder.image.image_utils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Converted 1024.00 MB image at 221.97 MB/s Jul 25 02:52:54 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 is being set with open permissions: ugo+rw Jul 25 02:52:54 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:54 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 Jul 25 02:52:54 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:55 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-7d46b7da-e80b-4667-934c-a64857d22663" released by "_copy_volume_from_snapshot" :: held 6.316s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-d173e8c5-af92-4d9b-89e7-2ed3fa36a836-7d46b7da-e80b-4667-934c-a64857d22663" released by "_create_volume_from_snapshot" :: held 6.352s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.375s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a192d3c1-dfd6-436e-8bfb-4de125e708ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d46b7da-e80b-4667-934c-a64857d22663', 'volume_size': 1, 'snapshot_id': 'd173e8c5-af92-4d9b-89e7-2ed3fa36a836'}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a8425-d812-473d-8073-92b9549e48de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Volume volume-7d46b7da-e80b-4667-934c-a64857d22663 (7d46b7da-e80b-4667-934c-a64857d22663): created successfully Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a8425-d812-473d-8073-92b9549e48de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Flow 'volume_create_manager' (7044bfdb-3c86-407f-83ed-22314c80881d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:55 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bc0adfee-9075-42c8-bece-10ebab26b0bd tempest-SnapshotDependencyTests-90968091 None] Created volume successfully. Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (a205d4a9-488a-435d-9bb8-10b7f5476e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7a62bf-bb3d-468d-86a8-e7677ee4c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7a62bf-bb3d-468d-86a8-e7677ee4c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074681838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a09f58-9bd8-45ac-b2b1-ba9774407676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:55Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787741c7-2502-47e2-a047-f9284a97ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787741c7-2502-47e2-a047-f9284a97ee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c26a6a1-2ba9-4001-8766-875f8ae2ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c26a6a1-2ba9-4001-8766-875f8ae2ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a09f58-9bd8-45ac-b2b1-ba9774407676', 'volume_name': 'volume-91a09f58-9bd8-45ac-b2b1-ba9774407676', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a05ae6-3e62-4ef4-89f5-4de5373ba67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a05ae6-3e62-4ef4-89f5-4de5373ba67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22236b76-fcc3-4ae8-abb5-ee7b45bb9b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:55 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Volume 91a09f58-9bd8-45ac-b2b1-ba9774407676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a09f58-9bd8-45ac-b2b1-ba9774407676', 'volume_size': 1} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074681838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a09f58-9bd8-45ac-b2b1-ba9774407676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:52:55Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Creating volume 91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:52:55 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:55 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 1073741824 Jul 25 02:52:55 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:55 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 1073741824" returned: 0 in 0.406s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:55 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:55 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 Jul 25 02:52:55 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:56 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22236b76-fcc3-4ae8-abb5-ee7b45bb9b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a09f58-9bd8-45ac-b2b1-ba9774407676', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b02bd81-ef8e-43d6-9c0d-17ad08bcb27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:52:56 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Volume volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 (91a09f58-9bd8-45ac-b2b1-ba9774407676): created successfully Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b02bd81-ef8e-43d6-9c0d-17ad08bcb27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (a205d4a9-488a-435d-9bb8-10b7f5476e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:52:56 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-9cb931b9-38e7-41af-b391-998283263773 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:UPDATE=185,cinder:SELECT=146,cinder:DELETE=16,cinder:INSERT=51 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:INSERT=44,cinder:UPDATE=173,cinder:SELECT=137,cinder:DELETE=16 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-d173e8c5-af92-4d9b-89e7-2ed3fa36a836-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-d173e8c5-af92-4d9b-89e7-2ed3fa36a836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-quobyte-59941dff-200a-421a-bfe0-a21e516e8f68" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot a66c317b-17ce-484e-a745-f1a20d8ac61c of volume 91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-59941dff-200a-421a-bfe0-a21e516e8f68" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-quobyte-d173e8c5-af92-4d9b-89e7-2ed3fa36a836" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2c5d1-b464-45d6-bc49-3a01763500f1]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-d173e8c5-af92-4d9b-89e7-2ed3fa36a836" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Deleting offline snapshot d173e8c5-af92-4d9b-89e7-2ed3fa36a836 of volume 59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] snapshot_file for this snap is: volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[245713cc-b725-495f-b461-c872c354b51f]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:56 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 Jul 25 02:52:56 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:56 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 Jul 25 02:52:56 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:56 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676" returned: 0 in 0.361s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:56 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:56 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c 1G Jul 25 02:52:56 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:57 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836" returned: 0 in 0.366s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59941dff-200a-421a-bfe0-a21e516e8f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7db7f-da5e-4841-9ccf-6f2e73028122]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:57 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:57 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:57 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c 1G" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:57 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c Jul 25 02:52:57 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:57 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:57 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 Jul 25 02:52:57 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:57 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c" returned: 0 in 0.297s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:57 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c is being set with open permissions: ugo+rw Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:57 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c Jul 25 02:52:57 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:57 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836" returned: 0 in 0.371s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:57 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836 Jul 25 02:52:57 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:57 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:57 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:57 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info Jul 25 02:52:57 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:58 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68.d173e8c5-af92-4d9b-89e7-2ed3fa36a836" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-d173e8c5-af92-4d9b-89e7-2ed3fa36a836" released by "_delete_snapshot" :: held 1.467s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-59941dff-200a-421a-bfe0-a21e516e8f68" released by "delete_snapshot" :: held 1.500s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Created reservations ['23727c6b-d101-4bfe-b266-9b42c59a4e15', 'f3f2bfe9-6a1f-40ca-8230-e5ac1d909dfb', '2bac587a-461e-4cea-8193-62561f7c1a57', '2054afc1-88af-4968-b5b2-31ec684a5ba3'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:58 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Delete snapshot completed successfully. Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info" returned: 0 in 0.269s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:58 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info is being set with open permissions: ugo+rw Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-59744f22-0b08-4092-a131-6fa95ae51b84 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-d173e8c5-af92-4d9b-89e7-2ed3fa36a836-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:58 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info Jul 25 02:52:58 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:58 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.info" returned: 0 in 0.241s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:58 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-be3d3c0e-9c89-4bc5-bb33-765a8b47f206 tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-a66c317b-17ce-484e-a745-f1a20d8ac61c-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-a66c317b-17ce-484e-a745-f1a20d8ac61c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-91a09f58-9bd8-45ac-b2b1-ba9774407676" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-59941dff-200a-421a-bfe0-a21e516e8f68-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-59941dff-200a-421a-bfe0-a21e516e8f68-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-91a09f58-9bd8-45ac-b2b1-ba9774407676" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-a66c317b-17ce-484e-a745-f1a20d8ac61c" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-a66c317b-17ce-484e-a745-f1a20d8ac61c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot a66c317b-17ce-484e-a745-f1a20d8ac61c of volume 91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bfc705-f83f-4c71-95f0-05a7bcd7e326]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-quobyte-59941dff-200a-421a-bfe0-a21e516e8f68" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-59941dff-200a-421a-bfe0-a21e516e8f68" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa1ec12-c11d-4359-a689-16a22daea5d5]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:58 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:58 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c Jul 25 02:52:58 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:58 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:58 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:59 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c" returned: 0 in 0.372s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91a09f58-9bd8-45ac-b2b1-ba9774407676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f72e94f-0712-49e4-83bd-9dc32e6144df]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:59 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.365s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:59 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68 Jul 25 02:52:59 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:59 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 Jul 25 02:52:59 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:59 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-59941dff-200a-421a-bfe0-a21e516e8f68" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-59941dff-200a-421a-bfe0-a21e516e8f68" released by "delete_volume" :: held 0.670s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Created reservations ['3f12811b-7dfa-4288-9080-20cb194b8be2', '82fb9c4a-f654-4a3a-826c-8b79322e0cc9', 'ee7e008e-74a2-4067-959b-d32d851b32e0', 'eb25cb08-9c0c-4a84-bc30-2267b1970288'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:52:59 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676" returned: 0 in 0.384s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:59 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c Jul 25 02:52:59 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:59 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:52:59 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:52:59 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:52:59 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Deleted volume successfully. Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-7d46b7da-e80b-4667-934c-a64857d22663-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-7d46b7da-e80b-4667-934c-a64857d22663-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-55ca6454-b6ba-4563-9d54-69bbee875408 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-59941dff-200a-421a-bfe0-a21e516e8f68-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "cinder-quobyte-7d46b7da-e80b-4667-934c-a64857d22663" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-7d46b7da-e80b-4667-934c-a64857d22663" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:52:59 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c" returned: 0 in 0.411s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb67fed-4433-4c4d-b676-ace9aa08e407]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:52:59 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:52:59 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c Jul 25 02:52:59 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:00 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 Jul 25 02:53:00 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:00 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676.a66c317b-17ce-484e-a745-f1a20d8ac61c" returned: 0 in 0.254s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-a66c317b-17ce-484e-a745-f1a20d8ac61c" released by "_delete_snapshot" :: held 1.531s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-91a09f58-9bd8-45ac-b2b1-ba9774407676" released by "delete_snapshot" :: held 1.563s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Created reservations ['bdb2a0b5-346e-4f59-8576-77bab4ee67ae', '67183a24-4486-46d3-8159-8ab7330b588b', '9c692642-0090-48ea-945e-4a3086b2797d', 'f70e9338-8450-4026-b605-c5ba28e43475'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:00 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663" returned: 0 in 0.386s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:00 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663 Jul 25 02:53:00 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:00 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-943a2409-568c-46ad-871f-94ceb8d13799 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-a66c317b-17ce-484e-a745-f1a20d8ac61c-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:00 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-7d46b7da-e80b-4667-934c-a64857d22663" returned: 0 in 0.246s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-quobyte-7d46b7da-e80b-4667-934c-a64857d22663" released by "delete_volume" :: held 0.678s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Created reservations ['5a6cabbd-5bc2-4554-bb0e-271466076f17', 'e7205a3f-d141-4b6e-b4ef-b4cd62d05310', 'b8b2a130-bf5b-4d58-bc2d-bc3c2f55babe', '8ee64b62-2148-4838-bb47-5040cf80a285'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:00 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:53:00 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-91a09f58-9bd8-45ac-b2b1-ba9774407676-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-91a09f58-9bd8-45ac-b2b1-ba9774407676-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-91a09f58-9bd8-45ac-b2b1-ba9774407676" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-91a09f58-9bd8-45ac-b2b1-ba9774407676" acquired by "delete_volume" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b09e27-a462-46f8-a1a9-eaf58504d2d7]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:00 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:01 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.272s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:53:01 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Deleted volume successfully. Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-91f3f0a5-ac14-497e-9ff8-b69d309b88b2 tempest-SnapshotDependencyTests-90968091 None] Lock "cinder-7d46b7da-e80b-4667-934c-a64857d22663-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:01 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 Jul 25 02:53:01 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:01 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:01 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676 Jul 25 02:53:01 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:01 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-91a09f58-9bd8-45ac-b2b1-ba9774407676" returned: 0 in 0.251s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-91a09f58-9bd8-45ac-b2b1-ba9774407676" released by "delete_volume" :: held 0.701s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Created reservations ['0fcb3cd6-03fd-4db0-86c5-5cf1f4c547ab', 'abf3f946-3bff-40a1-ab55-9a848498613f', '680861f2-1970-49f8-b049-d77fcb545fa5', '5dc2cfd3-bc08-4613-8da1-2e938cf3d789'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:01 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:01 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:53:01 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:02 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.300s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:53:02 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-ff9b4fc1-ec93-48ba-bf62-4a5ae2ea9837 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-91a09f58-9bd8-45ac-b2b1-ba9774407676-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (e4eb9854-cba3-463c-b522-d81ae336e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550367a8-b7c7-4b31-99b6-5b9b4bc7537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550367a8-b7c7-4b31-99b6-5b9b4bc7537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163843373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ff2182-8dbd-44c2-a60b-eac593f9a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:53:02Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1475ff47-300d-4c4b-9e56-d3555ea41dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1475ff47-300d-4c4b-9e56-d3555ea41dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b571a96-7c99-4066-a2f8-944697f72830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b571a96-7c99-4066-a2f8-944697f72830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ff2182-8dbd-44c2-a60b-eac593f9a678', 'volume_name': 'volume-15ff2182-8dbd-44c2-a60b-eac593f9a678', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449c2173-9007-43bb-a96c-9f95508cc7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449c2173-9007-43bb-a96c-9f95508cc7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f9338-9048-4464-9986-66e872ed61cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:02 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Volume 15ff2182-8dbd-44c2-a60b-eac593f9a678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ff2182-8dbd-44c2-a60b-eac593f9a678', 'volume_size': 1} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163843373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ff2182-8dbd-44c2-a60b-eac593f9a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:53:02Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Creating volume 15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:53:02 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:02 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 1073741824 Jul 25 02:53:02 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:02 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:02 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 1073741824" returned: 0 in 0.434s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:03 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 Jul 25 02:53:03 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:03 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678" returned: 0 in 0.266s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f9338-9048-4464-9986-66e872ed61cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ff2182-8dbd-44c2-a60b-eac593f9a678', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a799bc-84da-4417-a12f-b64ed10dfad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:03 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Volume volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 (15ff2182-8dbd-44c2-a60b-eac593f9a678): created successfully Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a799bc-84da-4417-a12f-b64ed10dfad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (e4eb9854-cba3-463c-b522-d81ae336e51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:53:03 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-bf6c6826-228e-432f-9648-426d18d72030 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot 7dec1d7a-5880-486c-92c7-86d0f833b81b of volume 15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8dc4a-27c7-43ba-b8ca-9b41af17aa4e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:03 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:03 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 Jul 25 02:53:03 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:04 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678" returned: 0 in 0.433s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:04 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b 1G Jul 25 02:53:04 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:04 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b 1G" returned: 0 in 0.427s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:04 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b Jul 25 02:53:04 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:04 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b" returned: 0 in 0.333s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:04 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b is being set with open permissions: ugo+rw Jul 25 02:53:04 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:04 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b Jul 25 02:53:04 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:05 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b" returned: 0 in 0.252s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:05 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info Jul 25 02:53:05 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:05 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info" returned: 0 in 0.261s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:05 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info is being set with open permissions: ugo+rw Jul 25 02:53:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:05 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info Jul 25 02:53:05 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:05 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.info" returned: 0 in 0.249s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:05 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:05 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-3b9eb315-6255-48c4-839e-206e44bc358e tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-7dec1d7a-5880-486c-92c7-86d0f833b81b-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-7dec1d7a-5880-486c-92c7-86d0f833b81b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-15ff2182-8dbd-44c2-a60b-eac593f9a678" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-15ff2182-8dbd-44c2-a60b-eac593f9a678" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-7dec1d7a-5880-486c-92c7-86d0f833b81b" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-7dec1d7a-5880-486c-92c7-86d0f833b81b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot 7dec1d7a-5880-486c-92c7-86d0f833b81b of volume 15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e60e85-13cc-4f3e-9b51-ee9cb9699d09]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:06 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:07 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b Jul 25 02:53:07 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:07 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b" returned: 0 in 0.392s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:07 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ff2182-8dbd-44c2-a60b-eac593f9a678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:53:07 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43fbe45-f12d-44f5-a1b2-d989224b1c87]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:07 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 Jul 25 02:53:07 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:07 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678" returned: 0 in 0.368s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:07 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:07 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b Jul 25 02:53:07 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:08 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:08 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b Jul 25 02:53:08 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:08 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678.7dec1d7a-5880-486c-92c7-86d0f833b81b" returned: 0 in 0.255s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-7dec1d7a-5880-486c-92c7-86d0f833b81b" released by "_delete_snapshot" :: held 1.497s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-15ff2182-8dbd-44c2-a60b-eac593f9a678" released by "delete_snapshot" :: held 1.522s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Created reservations ['d859aedf-2bf2-47fe-bf1b-c69737e628e9', '710c00fd-a389-46a9-9638-c4602151d461', '2590009d-f9ce-45e1-9d7b-a9638570bb07', 'ca382aff-2b7c-4bdd-aabf-41d6ee3691f2'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:08 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:53:08 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-f0f69384-9de3-4af3-87d0-4ecbfcdd4511 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-7dec1d7a-5880-486c-92c7-86d0f833b81b-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-15ff2182-8dbd-44c2-a60b-eac593f9a678-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-15ff2182-8dbd-44c2-a60b-eac593f9a678-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-15ff2182-8dbd-44c2-a60b-eac593f9a678" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-15ff2182-8dbd-44c2-a60b-eac593f9a678" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ebf5a-8463-400f-b6df-86978db12a11]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:09 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 Jul 25 02:53:09 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:09 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678" returned: 0 in 0.390s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:09 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678 Jul 25 02:53:09 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:09 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-15ff2182-8dbd-44c2-a60b-eac593f9a678" returned: 0 in 0.271s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-15ff2182-8dbd-44c2-a60b-eac593f9a678" released by "delete_volume" :: held 0.727s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Created reservations ['9d93800a-05e9-4d9f-8b5a-f0ff2e4e2806', '482fa41d-1fcd-45f2-b757-049876f4a254', '99d8cf14-cd53-43a4-9615-e484180657ad', 'a6b82e9e-ae78-4a56-82e2-4db9cf17e2c0'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:09 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:09 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:53:09 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:10 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.258s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:53:10 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-a3b5f140-b530-4459-ade5-5d4f6af4878f tempest-ProjectMemberTests-1855424396 None] Lock "cinder-15ff2182-8dbd-44c2-a60b-eac593f9a678-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (9d5a313a-f1dc-452f-8357-ded457bde3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce44ea20-1377-497e-b349-4124766edc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce44ea20-1377-497e-b349-4124766edc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823826029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6c13de-9c65-4b49-880d-92f3ef5da495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:53:11Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab798bb1-33c4-4dca-b7ea-4ac238d030f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab798bb1-33c4-4dca-b7ea-4ac238d030f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136868a4-8264-4250-96c5-507df3f5811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136868a4-8264-4250-96c5-507df3f5811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6c13de-9c65-4b49-880d-92f3ef5da495', 'volume_name': 'volume-9d6c13de-9c65-4b49-880d-92f3ef5da495', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d9614-a47b-4123-915e-686dc2eecd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d9614-a47b-4123-915e-686dc2eecd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d935e045-ea08-4352-910c-b370e6340268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:10 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Volume 9d6c13de-9c65-4b49-880d-92f3ef5da495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6c13de-9c65-4b49-880d-92f3ef5da495', 'volume_size': 1} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823826029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6c13de-9c65-4b49-880d-92f3ef5da495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:53:11Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Creating volume 9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:53:10 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:53:10 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:10 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 1073741824 Jul 25 02:53:10 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:11 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 1073741824" returned: 0 in 0.399s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:11 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 Jul 25 02:53:11 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:11 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495" returned: 0 in 0.243s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d935e045-ea08-4352-910c-b370e6340268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6c13de-9c65-4b49-880d-92f3ef5da495', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab46b66-2aaf-4022-82ac-4e5bf1baf540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:11 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Volume volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 (9d6c13de-9c65-4b49-880d-92f3ef5da495): created successfully Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab46b66-2aaf-4022-82ac-4e5bf1baf540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (9d5a313a-f1dc-452f-8357-ded457bde3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:53:11 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-dde2530c-3f23-49f9-a9f6-75f6205a5f19 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot 34d8a7a8-419e-4b3f-bdfa-32889abed45b of volume 9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edcdc7e-2d39-4bfc-8b45-6a6eb87827f4]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:11 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:11 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 Jul 25 02:53:11 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:12 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495" returned: 0 in 0.358s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:12 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b 1G Jul 25 02:53:12 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:12 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b 1G" returned: 0 in 0.387s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:12 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b Jul 25 02:53:12 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:12 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b" returned: 0 in 0.298s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:12 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b is being set with open permissions: ugo+rw Jul 25 02:53:12 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:12 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b Jul 25 02:53:12 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:13 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b" returned: 0 in 0.235s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:13 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info Jul 25 02:53:13 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:13 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info" returned: 0 in 0.262s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:13 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info is being set with open permissions: ugo+rw Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:13 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info Jul 25 02:53:13 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:13 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.info" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:13 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-643aae0d-5d1c-433b-9455-4b2e7461ca48 tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-34d8a7a8-419e-4b3f-bdfa-32889abed45b-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-34d8a7a8-419e-4b3f-bdfa-32889abed45b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-9d6c13de-9c65-4b49-880d-92f3ef5da495" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-9d6c13de-9c65-4b49-880d-92f3ef5da495" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-34d8a7a8-419e-4b3f-bdfa-32889abed45b" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-34d8a7a8-419e-4b3f-bdfa-32889abed45b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot 34d8a7a8-419e-4b3f-bdfa-32889abed45b of volume 9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4e221-fc75-4b89-b085-8ca1c346854c]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:13 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:14 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b Jul 25 02:53:14 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:14 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b" returned: 0 in 0.352s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:14 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d6c13de-9c65-4b49-880d-92f3ef5da495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:53:14 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2240f3-90bd-47fe-8627-fd101dd6c0d2]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:14 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 Jul 25 02:53:14 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:14 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:14 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:14 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b Jul 25 02:53:14 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:15 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b" returned: 0 in 0.340s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:15 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b Jul 25 02:53:15 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:15 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495.34d8a7a8-419e-4b3f-bdfa-32889abed45b" returned: 0 in 0.247s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-34d8a7a8-419e-4b3f-bdfa-32889abed45b" released by "_delete_snapshot" :: held 1.370s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-9d6c13de-9c65-4b49-880d-92f3ef5da495" released by "delete_snapshot" :: held 1.392s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Created reservations ['be1a03f9-aacc-4740-89df-c5551382b98b', '279390d5-da08-4fa7-a51f-b45cd2054a43', 'add00ce2-245a-4f37-b47e-cec462765614', '2c57fea1-fe53-46d0-947b-2267db1abd03'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:15 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:53:15 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-15516990-c8f2-4eef-8e9e-f33c31e4da42 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-34d8a7a8-419e-4b3f-bdfa-32889abed45b-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-9d6c13de-9c65-4b49-880d-92f3ef5da495-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-9d6c13de-9c65-4b49-880d-92f3ef5da495-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-9d6c13de-9c65-4b49-880d-92f3ef5da495" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-9d6c13de-9c65-4b49-880d-92f3ef5da495" acquired by "delete_volume" :: waited 0.018s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9acaafb-4681-4a18-b506-82ec95e0815a]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:16 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 Jul 25 02:53:16 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:16 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495" returned: 0 in 0.345s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:16 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495 Jul 25 02:53:16 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:16 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-9d6c13de-9c65-4b49-880d-92f3ef5da495" returned: 0 in 0.242s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-9d6c13de-9c65-4b49-880d-92f3ef5da495" released by "delete_volume" :: held 0.642s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Created reservations ['c29a2f86-3d88-4e05-af6f-95864a9a8f92', 'd77d3733-53a9-49db-8287-593a4281d889', '5bb67f2a-07c8-4892-a5b2-67f40a5412e3', '7aeef82e-2185-4862-a782-01d8a296116f'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:16 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:16 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:53:16 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:17 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.237s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:53:17 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-96540961-307b-4699-8ef0-b29849c9eef9 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-9d6c13de-9c65-4b49-880d-92f3ef5da495-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88279) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (37a47645-3edc-4480-ac36-1e996ae257fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce80f88a-1a93-4245-bb9f-569071bae57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce80f88a-1a93-4245-bb9f-569071bae57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168704235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3282767-293d-4c67-8122-b4b4f0028418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:53:18Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22a8b28-a5ac-4229-a1b4-736c18e210d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22a8b28-a5ac-4229-a1b4-736c18e210d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd25966-cf41-46ca-9174-14ac6dc409cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd25966-cf41-46ca-9174-14ac6dc409cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3282767-293d-4c67-8122-b4b4f0028418', 'volume_name': 'volume-c3282767-293d-4c67-8122-b4b4f0028418', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b53926-0493-48cc-8d15-5998574ad9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b53926-0493-48cc-8d15-5998574ad9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009baa4-8c5a-42cf-b5c7-261e1c407121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:17 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Volume c3282767-293d-4c67-8122-b4b4f0028418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3282767-293d-4c67-8122-b4b4f0028418', 'volume_size': 1} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-25T00:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168704235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3282767-293d-4c67-8122-b4b4f0028418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6731b80de9b24f869162bc18783cd854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-25T00:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-25T00:53:18Z,use_quota=True,user_id='f6d8f2be3a6b426a86f5c8c7cb330939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db630d57-062c-4085-ba2d-9a0a8a2d6064),volume_type_id=db630d57-062c-4085-ba2d-9a0a8a2d6064)}" {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Creating volume c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Selected osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac as target Quobyte volume. {{(pid=88279) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 25 02:53:17 devstack cinder-volume[88279]: INFO cinder.volume.drivers.remotefs [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] casted to osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac Jul 25 02:53:17 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 1073741824 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:17 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 1073741824 Jul 25 02:53:17 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:18 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 1073741824" returned: 0 in 0.409s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:18 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 Jul 25 02:53:18 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:18 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'} {{(pid=88279) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009baa4-8c5a-42cf-b5c7-261e1c407121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3282767-293d-4c67-8122-b4b4f0028418', 'volume_size': 1}' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0218f7-7e55-4d14-8dc7-12b322d1f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 25 02:53:18 devstack cinder-volume[88279]: INFO cinder.volume.flows.manager.create_volume [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Volume volume-c3282767-293d-4c67-8122-b4b4f0028418 (c3282767-293d-4c67-8122-b4b4f0028418): created successfully Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0218f7-7e55-4d14-8dc7-12b322d1f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88279) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Flow 'volume_create_manager' (37a47645-3edc-4480-ac36-1e996ae257fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88279) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 25 02:53:18 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-6c1611d2-14a3-4795-a2c8-132bb8e55439 tempest-ProjectMemberTests-1855424396 None] Created volume successfully. Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Creating offline snapshot 5d5b84b0-d6c7-4b57-9ca3-8257a50d644e of volume c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[54891ce2-86d3-421f-88ce-1dde104b3a2e]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:18 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:18 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 Jul 25 02:53:18 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:19 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418" returned: 0 in 0.348s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e 1G {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:19 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e 1G Jul 25 02:53:19 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:19 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e 1G" returned: 0 in 0.387s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3282767-293d-4c67-8122-b4b4f0028418 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:19 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3282767-293d-4c67-8122-b4b4f0028418 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e Jul 25 02:53:19 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:19 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3282767-293d-4c67-8122-b4b4f0028418 -F qcow2 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" returned: 0 in 0.294s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:19 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e is being set with open permissions: ugo+rw Jul 25 02:53:19 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:19 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e Jul 25 02:53:19 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:20 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" returned: 0 in 0.240s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:20 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info Jul 25 02:53:20 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:20 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info" returned: 0 in 0.244s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:20 devstack cinder-volume[88279]: WARNING cinder.volume.drivers.remotefs [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info is being set with open permissions: ugo+rw Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:20 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info Jul 25 02:53:20 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:20 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.info" returned: 0 in 0.243s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:20 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-61f94d42-5c06-4c39-ab55-0fe15b9f4078 tempest-ProjectMemberTests-1855424396 None] Create snapshot completed successfully Jul 25 02:53:20 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-5d5b84b0-d6c7-4b57-9ca3-8257a50d644e-delete_snapshot" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-5d5b84b0-d6c7-4b57-9ca3-8257a50d644e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-c3282767-293d-4c67-8122-b4b4f0028418" by "delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-c3282767-293d-4c67-8122-b4b4f0028418" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" by "_delete_snapshot" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Deleting offline snapshot 5d5b84b0-d6c7-4b57-9ca3-8257a50d644e of volume c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] snapshot_file for this snap is: volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e {{(pid=88279) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9dd86e-6173-43a3-bfa0-17a6acdc88df]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:21 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e Jul 25 02:53:21 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:21 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" returned: 0 in 0.348s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.remotefs [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3282767-293d-4c67-8122-b4b4f0028418(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88279) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07dc9d9-8ebc-41d6-8548-941cb8692adb]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:21 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 Jul 25 02:53:21 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:21 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418" returned: 0 in 0.343s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:21 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:21 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e Jul 25 02:53:21 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:22 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" returned: 0 in 0.329s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:22 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e Jul 25 02:53:22 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:22 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418.5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" returned: 0 in 0.236s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-5d5b84b0-d6c7-4b57-9ca3-8257a50d644e" released by "_delete_snapshot" :: held 1.343s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-c3282767-293d-4c67-8122-b4b4f0028418" released by "delete_snapshot" :: held 1.364s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Created reservations ['17b71e52-5151-42d2-a45c-2ee2f4894b4c', 'd0e64d94-63d1-48ee-865a-5622e33dcec2', 'cd431cdf-e000-4cc0-9137-42f147f2ef98', 'ce4e0949-8cec-4296-84b9-10ae5c30b410'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:22 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Delete snapshot completed successfully. Jul 25 02:53:22 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-2678903e-0f28-4120-9c02-c06f184a85c7 tempest-ProjectMemberTests-1855424396 None] Lock "cinder-5d5b84b0-d6c7-4b57-9ca3-8257a50d644e-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-c3282767-293d-4c67-8122-b4b4f0028418-delete_volume" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Lock "cinder-c3282767-293d-4c67-8122-b4b4f0028418-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Acquiring lock "cinder-quobyte-c3282767-293d-4c67-8122-b4b4f0028418" by "delete_volume" {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-c3282767-293d-4c67-8122-b4b4f0028418" acquired by "delete_volume" :: waited 0.014s {{(pid=88279) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309e314-b682-4153-87a4-a8576af0e2b0]: (4, 'qcow2') {{(pid=89465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:23 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 Jul 25 02:53:23 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:23 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418" returned: 0 in 0.349s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:23 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418 Jul 25 02:53:23 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:23 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858/volume-c3282767-293d-4c67-8122-b4b4f0028418" returned: 0 in 0.241s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Lock "cinder-quobyte-c3282767-293d-4c67-8122-b4b4f0028418" released by "delete_volume" :: held 0.647s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.quota [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Created reservations ['81792c97-f886-4d38-a7f9-d338273ef032', 'ab16c940-dbaf-4be0-a74f-5072f349a112', '7599c92f-4baf-4d1f-a071-0cbbed6ecd95', 'd5e29b2d-cf08-46f3-93eb-f5ff5e25a8c2'] {{(pid=88279) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:23 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:23 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:53:23 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:24 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:24 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.233s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:24 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:53:24 devstack cinder-volume[88279]: INFO cinder.volume.manager [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Deleted volume successfully. Jul 25 02:53:24 devstack cinder-volume[88279]: DEBUG cinder.coordination [None req-04f8e10f-459c-46d0-9f1d-56f2080bedaa tempest-ProjectMemberTests-1855424396 None] Lock "cinder-c3282767-293d-4c67-8122-b4b4f0028418-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88279) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 25 02:53:33 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:INSERT=26,cinder:SELECT=76,cinder:UPDATE=83,cinder:DELETE=6 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:53:34 devstack cinder-volume[88279]: DEBUG dbcounter [-] [88279] Writing DB stats cinder:SELECT=62,cinder:UPDATE=97,cinder:INSERT=25,cinder:DELETE=7 {{(pid=88279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac': None} {{(pid=88279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG cinder.volume.drivers.quobyte [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a83941d9-e3d5-4992-9134-46b04baf50ac'] {{(pid=88279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.lockutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88279) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 25 02:53:50 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 25 02:53:50 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858 Jul 25 02:53:50 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 25 02:53:51 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Jul 25 02:53:51 devstack cinder-volume[88279]: DEBUG oslo_concurrency.processutils [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d62f60956437d5c0c7510a4a5f61a858" returned: 0 in 0.250s {{(pid=88279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 25 02:53:51 devstack cinder-volume[88279]: DEBUG cinder.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Notifying Schedulers of capabilities ... {{(pid=88279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 25 02:53:51 devstack cinder-volume[88279]: DEBUG oslo_service.periodic_task [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] Running periodic task VolumeManager._thread_info {{(pid=88279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 25 02:53:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread count: 28 {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 25 02:53:51 devstack cinder-volume[88279]: DEBUG cinder.volume.manager [None req-c9c68981-7326-420c-9b84-05cc3e0086d4 None None] thread info: [<_MainThread(MainThread, started 139553316085888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}